Checks / AI crawler access
No llms-full.txt (optional)
llms-full.txt carries your key pages as plain text. No major assistant is confirmed to read it, so treat this as optional.
llms_full_missing · AI crawler access · Notice
What triggers it
/llms-full.txt on your domain answers with a clear "not found". An unclear answer is reported as not measured.
What to change
Optional: publish /llms-full.txt with the text of your main pages.
Example
Contents of /llms-full.txt:
# Example Shop
## Shipping and returns
Orders ship within 2 working days. Returns are free for 30 days.
## Sizing
The trail shoes run half a size small: order one size up.
How to confirm the fix
- Open https://example.com/llms-full.txt: it should show plain text
How common it is
We have not measured how common this is on a sample of sites. Counts appear here when a study covers it.
About this check
| Check ID | llms_full_missing |
|---|---|
| Report section | AI crawler access |
| Severity | Notice |
| How it is decided | Measured: read directly from the page or the server's response. |
| Added | Before 19 Oct 2026 (versions 1 and 2), or a site-wide check with no version date yet |
| Status | Measured in every report |
| Report gives the code | No, the fix is described in words |
Related checks
- robots.txt blocks PerplexityBot
- Your firewall or CDN refuses AI search crawlers
- llms.txt points at pages that crawlers cannot use
- No llms.txt (optional)
See whether it applies to your site
Paste your address and we crawl up to 10 pages and show every issue we find, with its fix. No account, no card.
Every plan crawls up to its page limit and lists these checks with the fix: plans.
How an audit works: method