During configuration, preview of captured data was generated and displayed correctly, but during mining (Start Mine) no data was extracted.
Please try the following to solve this problem :-
1. Increase the 'Script Load Wait Time' in Miner Settings. The default value of this setting is 5 seconds. Increase it to 10, 15 or 20 seconds and see if WebHarvy is able to get results during mining.
2. Soon after starting configuration, click anywhere on the page and select More Options > Page > Scroll Down from the resulting Capture window. Then continue with the configuration.
3. If the website from which you are trying to scrape data require login (with a user name and password), to view the data which you need to extract, then please make sure that you follow the steps given at Scraping websites which require login.
4. Delete browsing history and try mining (Start Mine) again. WebHarvy > Home menu > Settings > Browser tab > Delete Cache / Browsing History > Click (see Browser Settings Window). This will delete browsing history including cookies/cached files. Then try mining again.
5. Edit the configuration (Home menu > Edit) and see if the configuration start page as well as the preview data is loaded and displayed correctly. If the problem is related to loading the start page, then it can be identified here. You can fix problems related to starting page URL and Post data by selecting Configuration menu > Edit > StartURL / PostData.
6. Sometimes web servers may block your IP for continuously scraping their pages. In such cases you should try Scraping via Proxy Servers to avoid detection as well as to continue mining data.
7. You may also try changing the user agent string associated with the mining browser. User agent string can be set in WebHarvy Browser Settings. Enable custom user agent string option and provide user agent string for browsers like FireFox or Edge.
8. Open WebHarvy Settings and click on Advanced Miner Options button. Change the value of Data selection accuracy setting to Low or Medium and apply the change. Try again by creating a new configuration.
9. For scraping data from search result pages, if the results page does not have its own URL, the search needs to be performed as part of the configuration. Start Configuration after loading the search form. Use the page interaction options in Capture window (Input Text, Select Dropdown, Click etc.) to perform search and load the results page, from where you can select the required data.