# XML sitemap checker

Check that your XML sitemap is declared in robots.txt, parses, lists only URLs on your own site, includes the page you scan and tells crawlers when each page last changed.

Run it at https://crawlwise.dev/tools/sitemap-checker: paste a public URL, no account needed. The scan runs the full CrawlWise audit and returns a private report.

## What this checker tests

- sitemap.xml is valid and current (`discovery.sitemap`)
- robots.txt is reachable and valid (`discovery.robots`)

## What the report shows

- whether robots.txt declares a sitemap, and the HTTP status of each sitemap fetched;
- whether the sitemap parses as XML, and whether it is a URL set or an index of child sitemaps;
- how many URLs it lists, and whether any of them belong to another site. Foreign URLs fail,
  because search engines ignore them and they usually mean a copied or misconfigured sitemap;
- whether the scanned page is listed, and whether entries carry `lastmod` dates.

A server error on the sitemap fails. A missing sitemap warns: small sites are found through links,
but a sitemap is the cheapest way to tell crawlers about new and changed pages.

## Common mistakes

- **Staging or HTTP URLs.** A sitemap generated on another environment lists the wrong host.
- **Non-canonical URLs.** Redirecting, `noindex` or parameter URLs in the sitemap send crawlers
  mixed signals. List the URL each page names as canonical.
- **No Sitemap line in robots.txt.** Add `Sitemap: https://example.com/sitemap.xml`.
- **A sitemap that is never updated.** Generate it from the same source as your pages.

## Fix it

Generate the sitemap from your routes or CMS, serve it at a stable URL and declare it in
robots.txt with an absolute URL. The [robots.txt checker](/tools/robots-txt-checker) checks the
file that declares it, and the [agent-ready website checklist](/guides/agent-ready-website-checklist)
covers the rest of crawler discovery.

## FAQ

### Where does CrawlWise look for my sitemap?

It reads the Sitemap lines in robots.txt first. Without one it tries /sitemap.xml at the root of the scanned host. A sitemap that works but is not declared in robots.txt gets a warning, because crawlers that do not guess the URL will not find it.

### Does the checker follow sitemap index files?

Yes. It follows a sitemap index and gzip-compressed child sitemaps, up to ten sitemap documents, twenty child declarations and 50,000 URL entries. Each file is read up to 5 MB before and after decompression; the report lists any file it could not expand.

### Why does it warn that my page is not in the sitemap?

The scanned URL, after redirects, was not found among the sitemap's entries. Crawlers still find pages through links, but a sitemap that misses important pages is a weaker discovery signal. Check that the sitemap lists the canonical URL, with the same scheme, host and trailing slash.

### Do lastmod dates matter?

Google and Bing use lastmod to decide what to recrawl, but only when the dates are accurate. A lastmod that changes on every build without a content change teaches crawlers to ignore it.

## Related guides

- [Is your site agent-ready? A practical checklist](https://crawlwise.dev/guides/agent-ready-website-checklist.md)

---

Last updated 19 November 2026.

HTML version: <https://crawlwise.dev/tools/sitemap-checker>

Every CrawlWise page in Markdown: <https://crawlwise.dev/llms.txt>
