Troubleshooting

Solutions to commonly faced problems while trying to scrape data using WebHarvy

Troubleshooting: Mining process is slow
Please try the following steps to speed up web scraping. 1. Decrease the 'Page Load Timeout' (to 10 seconds or below depending on your interne...
Mon, 24 Jul, 2023 at 10:56 AM
Troubleshooting : No data during mining
During configuration, preview of captured data was generated and displayed correctly, but during mining (Start Mine) no data was extracted. Please try the...
Mon, 24 Jul, 2023 at 10:59 AM
Troubleshooting : Mining stops before completion
Mining stops before the requested/total number of pages are scraped This usually happens when WebHarvy is unable to load the next page of data by clicking...
Mon, 24 Jul, 2023 at 11:01 AM
Troubleshooting : Next page not loading / Data extracted only from the first page
During mining data is extracted only from the first page. Mining stops after first page extraction, or more pages are loaded but no more data is extracted....
Mon, 24 Jul, 2023 at 11:03 AM
Data within Frame / Unable to select data during configuration
After starting configuration, Capture window is not displayed when an item (text/image) is clicked. Update: WebHarvy 5.5 and later versions have a new cap...
Tue, 30 Mar, 2021 at 6:28 PM
Troubleshooting : Only items from first column of a table are selected
While scraping items displayed in table/grid layout, only the first column items are selected/extracted. For example, product listings are often displayed...
Mon, 24 Jul, 2023 at 11:11 AM
Troubleshooting tips : Mining does not stop. Last page data is repeatedly extracted.
This usually happens when WebHarvy is unable to detect the end of pagination. This can be avoided by enabling the Automatically remove duplicate records whi...
Tue, 30 Mar, 2021 at 6:29 PM
Troubleshooting : Mining aborts followed by configuration browser / application crash
Mining terminates prematurely followed by the configuration browser going blank. If you try to load any page in the browser after closing the miner window,...
Mon, 24 Jul, 2023 at 11:11 AM
Troubleshooting tips : Unlocking the software fails with message "Activation failed due to unknown reason"
WebHarvy registration involves online activation. So, internet connection is required for successful registration/unlock of trial version of WebHarvy using...
Tue, 30 Mar, 2021 at 6:29 PM
When 'Start-Mine' is clicked, Miner window is not displayed. Taskbar preview shows blank window.
This problem usually happens when WebHarvy is run with multiple monitors attached to your computer/laptop and later you have disconnected the extra monitor...
Tue, 30 Mar, 2021 at 6:30 PM