Can AI crawlers reach autodoc.co.uk?
Per-bot results
Origin fingerprint
Bot protection: Cloudflare (passive)
What this means for autodoc.co.uk
On autodoc.co.uk, 6 AI crawlers are blocked - GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-User, PerplexityBot, and 2 can reach the site - Google-Extended, Applebot-Extended. The origin resolves to Cloudflare.
Of the blocked crawlers, 2 are disallowed in robots.txt (GPTBot, ClaudeBot), and 4 are stopped at the network edge (OAI-SearchBot, ChatGPT-User, Claude-User, PerplexityBot).
autodoc.co.uk scores higher than 0% of the 25 sites checked here so far; the average AI access score is 90/100.
Unblock the AI bots on Cloudflare
autodoc.co.uk sits behind Cloudflare, so the block is almost certainly the "Block AI bots" control rather than robots.txt. In the Cloudflare dashboard open Security then Bots and turn off "Block AI bots", then check WAF custom rules for anything matching AI user-agents and add an allow rule for the verified bots (GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-User, PerplexityBot).
AI crawler access FAQ
Does AI crawler access guarantee autodoc.co.uk gets cited?
No. Access is necessary, not sufficient - it removes the blocker. Whether autodoc.co.uk gets cited still depends on content, structured data and authority.
How is this measured?
We parse autodoc.co.uk's public robots.txt and fingerprint its origin (ASN and bot-protection vendor), then score the share of 8 tracked AI crawlers that can reach it. No private data or IP addresses are shown.
Check your own site free
Run the same per-bot check on any URL, then sign up free to have ChatGPT Search and Perplexity actually fetch it - the real-world test - plus monitoring and exports.
Run a free checkAI crawler access on Cloudflare
We have checked 14 other sites on Cloudflare. The Cloudflare hub aggregates per-bot block rates and average access scores across every Cloudflare site checked here.
Related: Check another site · Agent Readiness Checker · Structured Data Tester.