Crawler

Crawler Info

The crawler reads your sitemap.xml file and stores the content of each discovered URL in the database for further analysis.

How it works
  1. Enter the sitemap.xml URL of the website you want to analyze
  2. The crawler reads all URLs from the sitemap
  3. Each URL is fetched and its content is stored
  4. The data is then available for SEO analyses