Does Cloudflare block AI crawlers?
AI crawler access on Cloudflare
We have checked 13 sites hosted on Cloudflare. They score 96/100 on average for AI crawler access, and 12 of 13 let every tracked AI crawler through.
These numbers describe the sites checked here, not Cloudflare as a whole - it is a sample of whoever has run the free checker, not a random one. Treat it as a read on how Cloudflare sites are usually configured, not a platform benchmark.
Which AI crawlers Cloudflare sites block
Across the 13 checked Cloudflare sites that returned per-bot verdicts.
| AI crawler | Sites blocking it | Share |
|---|---|---|
| ChatGPT-User | 1 / 13 | 8% |
| ClaudeBot | 1 / 13 | 8% |
| Claude-User | 1 / 13 | 8% |
| PerplexityBot | 1 / 13 | 8% |
Every Cloudflare site we have checked
Each links to its full report - per-bot verdicts, origin fingerprint and the specific fix.
AI crawler access on Cloudflare: FAQ
Does Cloudflare block AI crawlers by default?
Not universally. Of the 13 Cloudflare sites checked here, 12 let every tracked AI crawler through, so blocking on Cloudflare is a configuration choice rather than a platform default.
How is the AI crawler access score measured?
For each site we parse its public robots.txt and fingerprint its origin (ASN plus bot-protection vendor), then score the share of tracked AI crawlers that can actually reach it. The hub figure is the average across every checked Cloudflare site.
Where does this data come from?
Every site anyone has run through the free AI Crawler Access Checker on this site. It grows as more sites are checked, so the averages move over time.
Check your own site free
Run the same check on any URL - no login, no card. Sign up free to have ChatGPT Search and Perplexity actually fetch it, plus monitoring and exports.
Run a free checkRelated: All hosts · Agent Readiness Checker · Structured Data Tester.