Using the Add URLs to Configuration feature you can scrape data from multiple URLs using a single configuration. This requires that all URLs belong to the same domain/website and share the same page layout. The following are the steps involved.


Only a single row of data from each URL


1. Open WebHarvy and navigate to the first URL in the list
2. Start configuration
3. Select Configuration menu > Edit > Disable pattern detection option (tick).
4. Select required data
5. Select Configuration menu > Edit > URLs
6. In the resulting window paste all the remaining URLs in the list and click Apply button
7. Stop configuration
8. Start Mine - all URLs in the list will be mined using the same configuration


Multiple rows of data from each URL, spanning multiple pages


1. Open WebHarvy and navigate to the first URL in the list
2. Start configuration
3. Select required data, Select Next Page Link, Follow links and select data if required
4. Select Configuration menu > Edit > URLs
5. In the resulting window paste all the remaining URLs in the list and click Apply button
6. Stop configuration
7. Start Mine - all URLs in the list will be mined using the same configuration


By enabling the Tag with Category/Keyword option in Miner Settings an additional column can be added to the data table filled with the URL from which the row of data is mined.


Reference : https://www.webharvy.com/articles/howto.html