Checks / AI crawler access
No llms.txt (optional)
llms.txt is a short map of your site written for AI assistants. No major assistant is confirmed to read it, so treat this as optional.
llms_txt_missing · AI crawler access · Notice
What triggers it
/llms.txt on your domain answers with a clear "not found". An unclear answer is reported as not measured.
What to change
Optional: publish /llms.txt. A draft built from your pages is in the fix box.
Example
Contents of /llms.txt:
# Example Shop
> One sentence on what the site offers and who it is for.
## Main pages
- [Products](https://example.com/products): the range
- [Shipping and returns](https://example.com/shipping): costs, delays and returnsHow to confirm the fix
- Open https://example.com/llms.txt: it should show plain text, not your 404 page
How common it is
On a sample, the study measured sites with no valid llms.txt: 192 of 292 Show HN sites (66%), and 53 of 65 Lovable sites (82%).
Fetched 20 and 21 Oct 2026 as CitedBot, robots.txt obeyed, no JavaScript. Study: Launch crawl 2026-10 (English).
Counted with the check's own rule, leaving out sites that refused the request (HTTP 403): CSV of the counts.
About this check
| Check ID | llms_txt_missing |
|---|---|
| Report section | AI crawler access |
| Severity | Notice |
| How it is decided | Measured: read directly from the page or the server's response. |
| Added | Before 19 Oct 2026 (versions 1 and 2), or a site-wide check with no version date yet |
| Status | Measured in every report |
| Report gives the code | Yes, one block for the site |
Settings by platform
Where the setting lives on a few platforms, from each platform's own help page, read on 27 October 2026. On any other server, apply the fix box above.
WordPress (Yoast SEO)
In WordPress (Yoast SEO): Yoast SEO → Settings → Site Features → AI tools → LLMS.txt. (WordPress (Yoast SEO) help page)
Switch it on and save. It works in the free and the premium version, but not on WordPress multisite.
Shopify (Yoast SEO app)
In Shopify (Yoast SEO app): Yoast SEO → Settings → Advanced → llms.txt. (Shopify (Yoast SEO app) help page)
Switch on "Enable llms.txt feature" and save.
Shopify
Shopify serves /llms.txt by itself, from its /agents.md. To write your own, add a template to your theme:
In Shopify: Online Store → Themes → … → Edit code → Templates → New File → llms.txt.liquid. (Shopify help page)
Squarespace
In Squarespace: SEO/AI Visibility panel → SEO Settings → LLMS.txt. (Squarespace help page)
The file stays off until you add text to its field. It is available on version 7.1 sites.
Related checks
- No llms-full.txt (optional)
- llms.txt points at pages that crawlers cannot use
- robots.txt blocks CCBot
- robots.txt blocks ClaudeBot
See whether it applies to your site
Paste your address and we crawl up to 10 pages and show every issue we find, with its fix. No account, no card.
Every plan crawls up to its page limit and lists these checks with the fix: plans.
How an audit works: method