HTTP Header Checker
Every header a server sends back, explained in plain language, including the one that can keep a page out of search results without leaving a trace in the HTML.
The header that quietly deindexes pages
X-Robots-Tag does everything the robots
meta tag does, from the response headers instead of the HTML. That makes it the hardest indexing
problem to find by hand: you can read the entire page source, see no noindex anywhere, and still be
excluded from every search engine.
It is typically set at the web server or CDN, often to exclude a staging environment, and it survives long after the reason for it has gone. If a page is inexplicably missing from search, the indexability checker tests this along with the other four causes.
Why there is no score
Plenty of header checkers finish with something like "Security: 76/100". We do not, because we would
have to make the number up. Whether a missing
Permissions-Policy matters depends on
what your page does; a static article and a page handling payments are not comparable on one scale.
This tool tells you what is set, what is not, and what each header does, and leaves the weighing to
the person who knows the site.