ChatGPT-User: what it is and how to block it
Visits pages when a ChatGPT user or a Custom GPT asks for them. It doesn’t crawl automatically.
Does ChatGPT-User follow robots.txt?
OpenAI says that because these visits are user-initiated, robots.txt rules may not apply.
What blocking it does
A Disallow is a signal only; OpenAI does not promise to follow it for user-initiated fetches. It has no effect on ChatGPT search inclusion.
Because OpenAI describes ChatGPT-User as fetching pages on a user's behalf, treat a robots.txt rule as a request rather than a guarantee. For a hard block, filter the user agent or OpenAI's published IP ranges at your server or CDN.
User-agent string
How it appears in your server logs (from OpenAI's documentation; the version number can change):
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot
Anyone can send this string. Verify real visits against the operator's published IP ranges or reverse DNS before trusting it.
Other OpenAI tokens
- GPTBot: model training. Crawls content that may be used to train OpenAI’s generative AI foundation models.
- OAI-SearchBot: ai search index. Surfaces websites in search results in ChatGPT’s search features.
Block ChatGPT-User everywhere
User-agent: ChatGPT-User
Disallow: /
Block only some folders
User-agent: ChatGPT-User
Disallow: /members/
Disallow: /drafts/
Explicitly allow it
User-agent: ChatGPT-User
Allow: /
A group that names ChatGPT-User replaces the * group for it. Copy any shared rules into this group too. Test the result.
ChatGPT-User questions
What is ChatGPT-User?
ChatGPT-User is operated by OpenAI. Visits pages when a ChatGPT user or a Custom GPT asks for them. It doesn’t crawl automatically.
How do I block ChatGPT-User?
Add "User-agent: ChatGPT-User" followed by "Disallow: /" to your robots.txt. OpenAI says that because these visits are user-initiated, robots.txt rules may not apply.
What happens if I block ChatGPT-User?
A Disallow is a signal only; OpenAI does not promise to follow it for user-initiated fetches. It has no effect on ChatGPT search inclusion.
Does blocking ChatGPT-User block other OpenAI crawlers?
No. OpenAI documents GPTBot, OAI-SearchBot separately; each needs its own User-agent line if you want to block it.