Noindex Checker
Checks the meta robots tag and the X-Robots-Tag header for noindex, and says whether the page can be indexed.
What this tool checks
Robots meta directives
Reports the directives found in <meta name="robots"> (and googlebot).
Why it matters: Robots meta directives such as noindex or nofollow directly control whether a page is indexed and whether its links are followed.
If it fails: Only use noindex/nofollow where you truly want to exclude the page or its links.
Source: developers.google.com/search/docs/crawling-indexing/robots-meta-tag
X-Robots-Tag header
Reports the directives found in the X-Robots-Tag HTTP response header.
Why it matters: X-Robots-Tag applies robots directives at the HTTP level and can silently deindex a page even when the HTML looks fine.
If it fails: Check that any X-Robots-Tag noindex/nofollow is intentional.
Source: developers.google.com/search/docs/crawling-indexing/robots-meta-tag
Page is indexable
Combines robots meta, googlebot meta and the X-Robots-Tag header to decide whether search engines are allowed to index this page.
Why it matters: If a page you want in search results carries a noindex directive, it will be dropped from the index regardless of its content quality.
If it fails: Remove noindex from pages that should appear in search results. Keep it only on pages you deliberately want excluded.
Source: developers.google.com/search/docs/crawling-indexing/block-indexing
Related tools
- AI Crawler Blocked CheckerReads robots.txt and reports whether GPTBot, ClaudeBot, PerplexityBot and other AI crawlers are allowed in.
- Crawlability TestChecks status code, robots.txt, and noindex tag/header together — everything that decides whether a crawler can index the page.
- llms.txt CheckerChecks whether the site publishes an llms.txt file at its root and, if it does, that it has a title and markdown links.
- Googlebot SimulatorStrips the page to title, headings, readable text and links — what a basic crawler extracts.
- Robots.txt CheckerChecks robots.txt exists, returns 200, and does not block this page.
- URL Status Code & Redirect CheckerReports the HTTP status code and the full redirect chain for the URL, however the redirects are configured.