How to allow or block AI crawlers on Shopify, Squarespace, Wix, Webflow, WordPress.com and Cloudflare
One page per platform: where its own help page says the setting lives, what it does and does not cover, and the one thing that page says that the others do not, each read on the date shown.
- Cloudflare: AI bot policies by Search, Agent and Training, and the changed defaultsCloudflare's Block AI Bots page splits AI bots into Search, Agent and Training, with Block, Block on pages with ads and Allow. Its page announced new defaults for 15 September 2026.
- Shopify: how to allow or block AI crawlers (and what robots.txt does not stop)Edit robots.txt.liquid to allow or block AI crawlers on Shopify. Shopify's own help page says a block affects open-web discovery only, not the product data it sends to ChatGPT and Copilot.
- Squarespace: the AI crawler checkbox blocks 26 bots, but not ChatGPT searchSquarespace's Crawlers panel has one box to block known AI crawlers. Its help page lists the 26 names it writes into robots.txt, and ChatGPT's search and user bots are not among them.
- Webflow: robots.txt rules and the Content-Signal header for AI useWhere Webflow's robots.txt editor is, which plan it needs and how its Content-Signal header separates AI training, search and AI input.
- Wix: block AI crawlers in the Robots.txt Editor (its example lists only four names)Wix's help page tells you to paste four user agents into the Robots.txt Editor. Where the editor is, what the example leaves out and the nosnippet option.
- WordPress.com: where the AI opt-out sits (a privacy setting, not robots.txt)WordPress.com treats AI opt-out as 'Prevent third-party sharing' under privacy settings. What its site-visibility guide says, reviewed 5 October 2026.