How the AI Search Readiness Checker works

Enter a page address and see whether AI search crawlers and search engines can reach and read it. Free, no sign-up.

What it checks

• Six crawlers: OAI-SearchBot, ChatGPT-User, Claude-SearchBot and PerplexityBot (AI search), plus Bingbot and Googlebot (search engines). For each one, the tool reads your robots.txt rule, then requests the page with that crawler’s real user agent and compares the answer with a normal browser request. Firewalls and bot-protection pages (Cloudflare and others) are detected.
• Indexability: HTTP status, redirect chain, noindex and canonical.
• Content without JavaScript: most AI crawlers do not run JavaScript. If the raw HTML is empty, the page is empty for them.
• Structured data: JSON-LD, and an Organization or Person with sameAs links (an entity signal).
• Page structure, sitemap and performance (PageSpeed). llms.txt is shown for information only and does not change the score.

What it does not measure

This tool does not tell you whether you actually appear in ChatGPT or Gemini answers. Technical readiness only means the crawlers can get through the door. Whether an AI recommends you still depends on your place in search results and the strength of your entity. I explain why in GEO Is Just SEO: How Brands Really Get Into AI Answers.

How the score works

The score starts at 100 and every warning or failure costs points. Critical blockers (noindex, an error status, or every AI crawler blocked) cap the score at 40. A score of 90 or more needs every measured check to pass. 85 and above is good, 50–84 is fair, below 50 is poor.

Why I built it

When I looked at my own site’s Cloudflare bot data, PerplexityBot had not visited once in 30 days, and Perplexity could not find me on the first try. Checking whether a site is open to AI crawlers meant digging through logs and robots.txt by hand. I built this tool to turn that into a single scan. I developed it myself as a WordPress plugin.

Frequently asked questions

How do I allow OAI-SearchBot in robots.txt?

Add a group for it, for example User-agent: OAI-SearchBot followed by Allow: /. OAI-SearchBot is the crawler behind ChatGPT search. GPTBot is a different crawler, used for training. You can block GPTBot and still allow OAI-SearchBot, so your pages can appear in ChatGPT search without being used as training data.

Does Cloudflare block AI crawlers?

It can. Cloudflare has settings that block AI crawlers, and on some sites they may be switched on without the owner noticing. If the checker shows a bot-protection page for an AI crawler while browsers get the real page, check the bot and AI crawler settings in your Cloudflare dashboard.

Can AI crawlers read JavaScript-heavy sites?

Usually not. Most AI crawlers read the raw HTML and do not run JavaScript. If your text only appears after scripts run, those crawlers may see an empty page. Server-side rendering or static HTML fixes this.

Do I need an llms.txt file?

It does no harm, but no major AI search engine has confirmed that it uses llms.txt to choose sources. That is why the checker only reports it for information and it does not change your score.

Why is Googlebot or Bingbot marked “Unverified”?

Many firewalls block requests that only claim to be Googlebot or Bingbot, because the real crawlers come from known IP addresses. The checker cannot tell that apart from a real block, so it does not fail you for it. Use the URL Inspection tool in Google Search Console, or Bing Webmaster Tools, to confirm.

Only the page you enter is scanned. You can run 2 new scans per hour; results are kept for 24 hours.