• To get URL of the currently loaded page, during configuration, click anywhere on the page and select More Options > Add Custom Data > Page URL from the resulting Capture window.
  • If you are following links from the starting page of the configuration, then (before following links) the Capture target URL option can be used to extract URLs of details pages.
  • If you are following URLs present in HTML source of the page, then while following the same method, after applying regular expression, when the URL of the page is displayed in the preview area of Capture window, you can click on Capture HTML button to capture the URL in a separate column.
  • If you are scraping data from a list of URLs, then by enabling the Tag with Category/Keyword option in Category/Keyword tab in Settings window, the URLs from which each row of data is scraped can be added as a separate column.
  • You can also use JavaScript to scrape the page URL. Follow the steps below.
    1. 1. During configuration, after selecting all required data from the currently loaded page, to get the URL of the page, click anywhere on the page and select More Options > Run Script from the resulting Capture window.
    2. 2. Paste and run the following JavaScript code.

      document.body.innerText = document.URL;

    3. 3. Now, you should be able to see the page URL displayed in the browser area.
    4. 4. Click on it and select Capture Text option from the resulting Capture window to capture it.
    5. 5. Ideally, you should stop configuration here. If for some reason you need to load the previous page in the browser, click anywhere on the page and select More Options > Run Script from the resulting Capture window. Paste and run the following code to go back to the previous page.

      window.history.back();