Should You Block ChatGPT’s Crawler?

The crawler question for ChatGPT is OAI-SearchBot (search) and GPTBot (training). Blocking is a real option with a real cost, and the two directions are not symmetric. ChatGPT answers from model weights first and reaches for the web when the question looks fresh, local or specific. Cituna shows the real cost of blocking by checking daily whether ChatGPT names you, links you, or names a rival without linking anyone.

How ChatGPT actually decides

ChatGPT’s search index is Bing-derived, so a page Bing has never indexed is effectively invisible to ChatGPT, no matter how well it ranks in Google.

Its citations skew toward encyclopedic and reference sources: published analyses put Wikipedia at roughly 47.9% of its top citations. In practice that means the surfaces worth auditing first are Wikipedia, established news and reference sites, vendor documentation, G2 and review aggregators.

The method, in order

Know which agent does what: OAI-SearchBot (search) and GPTBot (training). Training access and answer-time retrieval are usually separate controls, and blocking the wrong one achieves the opposite of what was intended.

Decide what you are protecting. Blocking reduces the chance of being quoted without attribution; it also reduces the chance of being recommended at all.

Consider the asymmetry. Being absent from ChatGPT is easy to cause and slow to undo, even here, where retrieval is live, reputation lags access.

If you do block, block deliberately and document it, so a future traffic investigation does not spend a week rediscovering it.

Re-check after any robots.txt change that the agent you meant to allow is still allowed.

The honest caveat

It is the slowest of the six to notice a new page, because a Bing-derived index has to find you first. Sites that only ever submitted a Google sitemap routinely discover they are absent here.

Cituna checks ChatGPT daily alongside Google AI Overviews, Claude, Gemini, Google AI Mode, Perplexity and Grok, on the $39 Starter, and pairs the result with Google Search Console so a change here can be tied to real clicks. Then it does the work: it generates the fix for each gap, its AutoSEO writes and publishes the articles that answer the questions you are missing, and Claude or any other AI agent can work through the results over MCP.

Drafted with AI assistance from our own research and Search Console data, and reviewed by Rahul A before publishing. Rules and prices change; check the linked official source before you act.

Frequently asked questions

How often does ChatGPT change its answer?

ChatGPT’s volatility is moderate, answers to the same prompt drift week to week as the underlying index refreshes. That is why a single check is not a measurement: the same prompt asked twice in a week can name different brands without anything on your site having changed. Fix the prompt set, check on a schedule, and read the trend rather than the reading. Cituna’s daily check of ChatGPT separates the effect of a crawler rule from ordinary drift in the answer.

Which crawler does ChatGPT use?

OAI-SearchBot (search) and GPTBot (training). This matters more than it sounds: robots.txt rules written years ago for Googlebot routinely block these agents by accident, and the symptom, being absent from one engine while doing fine elsewhere, looks like a content problem rather than an access one. Cituna asks ChatGPT your buyers’ questions every day, so any robots.txt change can be read against a dated record of who ChatGPT named and cited before it.

What is the fastest way to improve visibility in ChatGPT?

On the evidence, get indexed in Bing Webmaster Tools, then earn a mention on a reference-grade page. That is specific to this engine: ChatGPT favours encyclopedic and reference sources: published analyses put Wikipedia at roughly 47.9% of its top citations, so effort spent on surfaces it does not read produces very little movement here even when it helps elsewhere.