WakeupData's Crawl gives you access to our high-end and immensely effective web-crawler. It allows you to easily populate product data by going through products in a category list or values in a product variant page.
As a WakeupData user, you have access to our crawler and all its capabilities.
You can include any number of filters in order to accurately crawl the product you are looking for. This also allows you to exclude undesired pages, expression or paths.
Filters can include many different factors like tags, classes, styles, scripts, meta data, product descriptions, product variants or images.
The fastest and most effective process to crawl a website is as follows:
• Specify the exact paths you wish to crawl.
• Test the fetched data (visible in the 'test urls' in the screenshot above).
• Run the crawler immediately.
Check out the next blog post here, which looks at the next step in the crawl process, and the many possibilities in what your export can do to improve and enrich your product feed. Read our other blogs about how to give your ecommerce store the best possible solutions with the other Business Suite product, Recon.
Get in touch with a WakeupData consultant today and hear about the many possibilities efficient competitor monitoring and data feed management can give to you.