Troubleshooting

Solutions to commonly faced problems while trying to scrape data using WebHarvy

Empty cells in data table during mining | Data missing in some rows
During mining, some cells in the data table remain blank. This happens due to the following reasons: 1. Data is actually not present in the page 2. Pag...
Mon, 24 Jul, 2023 at 10:57 AM
'Follow this link' option is disabled when a link is clicked during configuration
During configuration, if you click on a link and find the Follow this link option disabled, then try applying Capture More Content option once or twice with...
Mon, 24 Jul, 2023 at 11:12 AM
Web page not loading. Browser displays 'Checking if site connection is secure' message.
Make the following change in WebHarvy Settings to resolve this problem. Go to WebHarvy Settings > Browser and select the Enable Custom User Agent String...
Mon, 24 Jul, 2023 at 11:13 AM
Only the first item on the page is selected/scraped
Only the first (clicked) item on the page is selected. Subsequent items are not scraped. Please try the steps given below to solve this problem: 1. O...
Mon, 24 Jul, 2023 at 11:14 AM
For infinite scroll / load-more type pagination, data is scraped only from the first page
For pages which load more data on the same page when scrolled down (infinite scroll) or when a load-more button/link is clicked, if only the first page data...
Mon, 24 Jul, 2023 at 11:32 AM
Page not fully loaded, after following link
During configuration, while following link from the starting page to select more details, the resulting page is not loaded correctly. The whole page is blan...
Mon, 24 Jul, 2023 at 11:15 AM
All items or images on the page are not scraped
During mining, not all items displayed on the page are scraped. Only the first few items or images are correctly scraped. This can happen if the page load...
Mon, 24 Jul, 2023 at 11:16 AM
Preview pane is not visible
'Captured Data Preview' pane in the main window is not visible Follow the steps given below to solve this problem. 1. Exit WebHarvy 2. Delete th...
Thu, 12 Oct, 2023 at 10:50 AM
Data selection difficulty due to slow text highlighting
Text highlighting during configuration is very slow, making data selection difficult. To solve this problem, go to WebHarvy Settings > Browser Settings ...
Thu, 12 Oct, 2023 at 10:50 AM
Incorrect links/buttons clicked during mining
Clicks are not working correctly during mining. Adjacent links/buttons are clicked instead of the correct one. To ensure that clicks are accurately directe...
Thu, 12 Oct, 2023 at 10:51 AM