Can AI read your site?
Check whether ChatGPT, Claude, Perplexity, Gemini, and other AI crawlers are allowed to read your site — and whether you have an llms.txt. If they’re blocked, AI can’t recommend you.
Enter a domain to see whether ChatGPT, Claude, Perplexity, Gemini, and other AI crawlers are allowed to read it.
How it works
We read your robots.txt
We fetch your robots.txt and llms.txt and check each major AI crawler's access rules — no signup, no install.
See who's allowed
A clear per-engine breakdown: which AI bots can crawl you, and which your site is turning away.
Fix what's blocking you
Open the right crawlers, add an llms.txt, then track whether AI engines actually start recommending you.
Letting AI in doesn’t mean AI picks you.
Unblocking the crawlers is table stakes. The real question is whether ChatGPT, Perplexity, Gemini, and Google AI Overviews actually recommend your brand when buyers ask — or send them to a competitor. Measure tracks exactly that, every day.
Frequently asked questions
What does this AI crawler checker do?
It reads a site's robots.txt and checks whether the major AI crawlers — GPTBot and OAI-SearchBot (ChatGPT), ClaudeBot and Claude-User (Anthropic), PerplexityBot, Google-Extended (Gemini & AI Overviews), and others — are allowed to access it. It also checks for an llms.txt file.
Why does AI crawler access matter?
If your robots.txt blocks an AI crawler, that engine generally can't read your content — so it can't cite or recommend you in its answers. With more people asking AI instead of Google, being readable by these crawlers is the entry ticket to AI search visibility.
What is llms.txt?
llms.txt is an emerging standard: a plain-text file at your domain root that gives AI models a curated, machine-friendly summary of your site. It's optional today, but a growing signal for AI-readiness.
Should I allow all AI crawlers?
It's a trade-off. Allowing them maximizes your chance of being seen and recommended in AI answers; some publishers block training crawlers (like GPTBot) for control while keeping search crawlers (like OAI-SearchBot) open. This tool shows you exactly where you stand so you can decide deliberately.
If I allow the crawlers, will AI recommend me?
Not automatically. Access is necessary but not sufficient — engines still choose which brands to name. Measure tracks whether ChatGPT, Perplexity, Gemini, and Claude actually recommend you, and shows you how to improve.
Get your brand named byChatGPT
Right now an answer is going out about your category, with or without you in it. Point Measure at the questions your buyers ask tonight, and read the transcript by morning.
Plans from $89/mo, cancel anytime.