Which well-known sites block AI search crawlers

I ran the AI-visibility checker on 32 well-known sites to see how many let the AI search crawlers read them. 17 of the 32 block at least one. 11 block both the crawler ChatGPT uses for citations (OAI-SearchBot) and the one Perplexity uses (PerplexityBot), so those sites cannot be cited by either engine right now. Another 6 block only Perplexity.

News publishers make up most of the blockers, and for them it is often a deliberate choice tied to content licensing. This page does not judge that. It reads each site's public robots.txt and reports what the robots.txt allows. For a business that wants to show up in AI answers, a blocked search crawler means the same thing either way: no citations from that engine.

Each site links to its full result. Re-checked automatically, most recently on 7 September 2026. A question mark means the site's robots.txt could not be fetched on the last run, so the honest answer is that I do not know.

Tracking started 2026-09-07. Nothing on this list has changed its robots.txt since then. Any change will be listed here with the date it was first seen.

Correction. npr.org was first published here as allowing both crawlers. That was wrong. The checker could not fetch npr.org's robots.txt and treated the failure as permission. npr.org blocks OAI-SearchBot and PerplexityBot. Corrected 7 September 2026.

A green check means the site allows that engine's search crawler. A red mark means its robots.txt blocks it. ChatGPT Search uses OAI-SearchBot; Perplexity uses PerplexityBot.