Is theguardian.com findable?
| Engine | What we saw | Next step |
|---|---|---|
Googlebot: reads the page | Nothing blocks Googlebot. Submit the sitemap in Search Console and check it shows a last-read date. | |
| Bing (also ChatGPT search and Copilot) | Bingbot: reads the page | Nothing blocks Bingbot. Add the site in Bing Webmaster Tools, submit the sitemap and send new pages through IndexNow. |
| AI assistants (ChatGPT, Perplexity, Claude) | OAI-SearchBot: reads the pagePerplexityBot: blocked by robots.txtClaude-SearchBot: blocked by robots.txt | Remove the robots.txt rule that blocks the crawler named in this row. |
Your sitemap
robots.txt names your sitemap and it lists 515 URLs. 515 of 515 sitemap URLs carry a lastmod date.
What this cannot show
Whether a page is indexed, shown in results or cited by an assistant. Only Google Search Console, Bing Webmaster Tools and your server log show that. Indexed and shown: not measured here.
Next: the rest of the site
This tool reads robots.txt, your sitemap and one page. The free check crawls a sample of pages and lists everything that keeps search engines and assistants from reading theguardian.com, with the exact fix for each.
Run the free check on theguardian.com