AI crawlers / AI crawlers
Applebot-Extended: opting out of Apple's model training without leaving search
What Applebot-Extended is
Apple's page describes Applebot-Extended as the way to keep content out of training for foundation models behind Apple Intelligence, services and developer tools. Like Google-Extended it is a control token: you will not find it in a log.
| Fact | Applebot-Extended |
|---|---|
| Operator | Apple |
| Job | Control token (no requests of its own) |
| robots.txt token | Applebot-Extended |
| Follows robots.txt | Read from robots.txt only |
| Published address list | None: it never fetches |
| Vendor page read | 21 October 2026 |
What the vendor says
In the vendor's words: “Web publishers can opt-out from having their content used to train generative foundation models by disallowing Applebot-Extended in the robots.txt file.”
Source: Apple Support: About Applebot, read on 21 October 2026.
What happens if you block it
Apple spells out the limit: if you disallow Applebot-Extended and also tag content with the nosnippet meta tag, your instructions may still allow Applebot to crawl the page, and the content remains discoverable through Spotlight, Siri and Safari. The same page says publishers can opt out of use in broad world-knowledge answers by applying this robots.txt control.
The robots.txt lines
To allow it:
User-agent: Applebot-Extended
Allow: /To block it:
User-agent: Applebot-Extended
Disallow: /How to tell a real request from a fake one
No network check exists for a token that sends no requests. Read robots.txt, on each host, and check Applebot separately, because the two tokens are independent and a single User-agent: Applebot-Extended group says nothing about Applebot.
Compare with Applebot
Applebot: The crawler itself: allowing it keeps you in Spotlight, Siri and Safari search.
Check your own site
The audit box above reads robots.txt for the crawlers in this set and sends one live request per crawler, so a rule that robots.txt allows but a firewall refuses shows up. The full list of crawlers is on the AI crawler hub.
Questions people ask
Why does Applebot-Extended not show up in my server logs?
It sends no requests. Apple describes it as a robots.txt control for whether crawled content is used for training.
Does Disallow Applebot-Extended remove me from Siri?
Apple says content stays discoverable through Spotlight, Siri and Safari because Applebot may still crawl it.
Sources
See what AI answers about your shop
The audit crawls your site up to your plan's page limit, shows which AI crawlers it lets in and gives the exact fix for each issue. From €9, 14-day money-back guarantee.
Audit my siteAudit from €9, paid once. 14-day money-back guarantee.