Free tools

Free AI readiness and SEO checkers

Each checker answers one question about how search engines, AI crawlers and agents see your site. They all run the same free CrawlWise scan, so one report answers every question.

  • AI crawler checker

    Free AI crawler checker: test if GPTBot, OAI-SearchBot, ClaudeBot and PerplexityBot can reach your site through robots.txt, Cloudflare and your firewall.

  • llms.txt checker

    Free llms.txt checker: see if your file is reachable, is Markdown, follows the llmstxt.org layout, and whether your pages serve Markdown to AI agents.

  • Can AI read your site without JavaScript?

    Free test of what AI crawlers see: compare your raw HTML with the rendered page to find content that ChatGPT, Claude and Perplexity miss without JavaScript.

  • Structured data checker for AI search

    Free JSON-LD checker for AI search: see if your schema.org markup parses, is in the server HTML, describes the page entity and carries valid dates.

  • WebMCP and agent discovery checker

    Free checker for agent protocols: WebMCP tools, MCP server cards, A2A agent cards, agent skills, API catalogs and OAuth discovery documents on your site.

  • robots.txt checker

    Free robots.txt checker: see if your file is reachable and valid, which search and AI bots it allows, and whether Googlebot can fetch your CSS and JavaScript.

  • XML sitemap checker

    Free XML sitemap checker: see if your sitemap.xml is reachable and valid, is declared in robots.txt, lists the scanned page and carries lastmod dates.

  • Redirect checker

    Free redirect checker: trace every hop from the URL you enter to the final page, spot temporary redirects and long chains, and check HTTPS and HSTS.

  • Indexability and canonical checker

    Free indexability checker: find noindex, nofollow and nosnippet in meta tags and X-Robots-Tag headers, check the canonical URL and validate hreflang.

  • Open Graph and meta tag checker

    Free Open Graph checker: see if your page has og:title, og:description and an absolute og:image, plus a title, meta description, H1 and lang attribute.

  • Security headers checker

    Free security headers checker: test Content-Security-Policy, X-Content-Type-Options, Referrer-Policy, frame protection and HSTS on your page.

Run the full audit

On the full audit form you can choose which categories open the report.

Last updated .