Indexability Checker
Enter a URL and see whether Google can actually index it — with the four signals that decide it (meta robots, X-Robots-Tag, canonical, robots.txt) cross-checked for the contradictions that quietly keep pages out of search.
Frequently asked questions
What decides whether a page gets indexed?
Four signals, and they have to agree: the meta robots tag, the X-Robots-Tag HTTP header, the canonical tag, and robots.txt. This tool reads all four for a URL and tells you the net result — plus, crucially, any conflicts between them (the “crawled, currently not indexed” trap).
Why is “blocked by robots.txt AND noindex” a problem?
It’s the most common silent indexing bug. If robots.txt blocks the URL, Google can’t crawl the page — so it never sees the noindex tag. The page can then stay in the index (often as a bare URL with no description). The fix is to allow crawling so the noindex is actually read, or rely on robots.txt alone without the noindex.
What does “canonicalised elsewhere” mean?
Your page’s canonical tag points to a different URL, telling Google “index that one instead of this.” That’s correct for duplicate or parameter URLs, but if it’s pointing somewhere unexpected, this URL won’t get indexed and its ranking signals flow to the canonical target. The tool flags it so you can confirm it’s intended.
Does this check robots.txt the way Google does?
It applies the same core rules Google uses: it finds the most specific user-agent group, matches your URL’s path against the Allow/Disallow rules with wildcard (*) and end-anchor ($) support, and lets the longest matching rule win (with Allow breaking ties). It’s a faithful approximation for the common cases.
Related free tools
Instant SEO Snapshot
One-click SEO & AI-readiness grade for any page — HTTPS, indexability, title, meta, headings, content & more. Embeddable on your own site.
AI Bot Access Checker
Can ChatGPT, Perplexity, Claude & Gemini crawl your site? Checks robots.txt + live CDN/WAF blocks.
AI Visibility Checker
See what ChatGPT, Claude & Perplexity know about your brand — and how to improve it.
NLP Content Analyzer
Topics, entities, search intent & content gaps an NLP model sees in your page.
AI Retrieval Checker
AI/AIO readiness — can ChatGPT, Perplexity & AI Overviews find, chunk & cite your page?
AI Crawler Log Analyzer
Upload your access log to see which AI bots (GPTBot, ClaudeBot, PerplexityBot) actually crawled you — with spoofed-vs-verified detection.
Want the full picture?
This tool checks one thing. Run a complete, free SEO audit across 26 factors in about a minute.
Run a free SEO audit