Can AI crawlers reach sephora.com?

Q: How is the AI crawler access score measured?

We parse sephora.com robots.txt and fingerprint its origin (ASN plus bot-protection vendor), then score the share of 8 tracked AI crawlers that can actually reach it. No private data is used.

AI crawler access report · checked 2026-07-03 · log in to re-run

25%

Access score

2/8

Bots allowed

PARTNER-AS - Partner Communications Ltd., IL

Hosting provider

Blocking AI crawlers

sephora.com blocks 6 of 8 AI crawlers (GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-User, PerplexityBot); Google-Extended, Applebot-Extended still get through.

Per-bot verdicts

GPTBotOrigin returned HTTP 403 to the GPTBot user-agent - blocked at the network edgeLikely blocked

OAI-SearchBotOrigin returned HTTP 403 to the OAI-SearchBot user-agent - blocked at the network edgeLikely blocked

ChatGPT-UserOrigin returned HTTP 403 to the ChatGPT-User user-agent - blocked at the network edgeLikely blocked

ClaudeBotOrigin returned HTTP 403 to the ClaudeBot user-agent - blocked at the network edgeLikely blocked

Claude-UserOrigin returned HTTP 403 to the Claude-User user-agent - blocked at the network edgeLikely blocked

PerplexityBotOrigin returned HTTP 403 to the PerplexityBot user-agent - blocked at the network edgeLikely blocked

Google-Extendedrobots.txt allows this bot, no challenge detectedAllowed

Applebot-Extendedrobots.txt allows this bot, no challenge detectedAllowed

Origin fingerprint

ASN: AS12400 (PARTNER-AS - Partner Communications Ltd., IL)
Bot protection: Cloudflare (passive)

What this means for sephora.com

On sephora.com, 6 AI crawlers are blocked - GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-User, PerplexityBot, and 2 can reach the site - Google-Extended, Applebot-Extended. The origin resolves to PARTNER-AS - Partner Communications Ltd., IL, behind Cloudflare (passive).

Of the blocked crawlers, none are disallowed in robots.txt, and 6 are stopped at the network edge (GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-User, PerplexityBot).

sephora.com scores higher than 0% of the 19 sites checked here so far; the average AI access score is 91/100.

Unblock the AI bots on Cloudflare

sephora.com sits behind Cloudflare, so the block is almost certainly the "Block AI bots" control rather than robots.txt. In the Cloudflare dashboard open Security then Bots and turn off "Block AI bots", then check WAF custom rules for anything matching AI user-agents and add an allow rule for the verified bots (GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-User, PerplexityBot).

Frequently asked questions

Does AI crawler access guarantee sephora.com gets cited?

No. Access is necessary, not sufficient - it removes the blocker. Whether sephora.com gets cited still depends on content, structured data and authority.

How is this measured?

We parse sephora.com's public robots.txt and fingerprint its origin (ASN and bot-protection vendor), then score the share of 8 tracked AI crawlers that can reach it. No private data or IP addresses are shown.

Check your own site free

Run the same per-bot check on any URL, then sign up free to have ChatGPT Search and Perplexity actually fetch it - the real-world test - plus monitoring and exports.

Run a free check

Recently checked

The latest public reports.

chewy.com100%wayfair.com100%lululemon.com100%tecovas.com100%ridgewallet.com50%