AI crawler · OpenAI

ChatGPT-User

The user agent ChatGPT uses when a person asks it to open or read a page.

Operator
OpenAI
Feeds
ChatGPT and Custom GPTs
Type
Live (answers users now)
robots.txt token
ChatGPT-User

Full user-agent string, as OpenAI documents it (version numbers can change):

Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot

What ChatGPT-User does

OpenAI uses ChatGPT-User for certain user actions in ChatGPT and Custom GPTs, such as visiting a page to answer a question. It is not used for automatic crawling or to decide what appears in ChatGPT search.

Does it follow robots.txt? Not reliably. OpenAI says that because these visits are started by a user, robots.txt rules may not apply.

How many popular sites block ChatGPT-User

11% of the Tranco top 500 sites whose robots.txt answered block ChatGPT-User for the whole site (35 of 319), as of . The number comes from our weekly AI crawler access study, which counts a site as blocking only when its robots.txt disallows the site root for this token.

robots.txt: allow or block ChatGPT-User

Put the group in the robots.txt at the root of every host it should cover (example.com and www.example.com each need their own).

Allow

User-agent: ChatGPT-User
Allow: /

Block

User-agent: ChatGPT-User
Disallow: /

Setting rules for several AI crawlers at once? The free AI robots.txt generator writes the groups for all of them.

A crawler follows only the most specific group that names it. Once you add a User-agent: ChatGPT-User group, it ignores your User-agent: * rules, so repeat any Disallow lines (admin areas, carts) you still want applied to it.

What blocking does and does not do

  • Does: A robots.txt rule records your preference, but OpenAI does not commit to honouring it for user-initiated visits. A firewall or CDN rule that refuses the user agent stops the fetch itself.
  • Does not: It does not remove you from ChatGPT search (that is OAI-SearchBot) and it does not change training (that is GPTBot).
  • Refusing ChatGPT-User at the server means ChatGPT cannot read your page when a user pastes your link or asks about it, which usually works against you.

Anyone can put "ChatGPT-User" in a user-agent. To confirm a visit is genuine, compare its IP with OpenAI's published list: https://openai.com/chatgpt-user.json.

Check whether your site blocks ChatGPT-User

Enter your page and our free crawler check opens with it filled in. It reads your robots.txt for ChatGPT-User and the other nine AI crawler tokens, then requests the page as ChatGPT-User to catch a server or CDN refusal. No signup.

Frequently asked questions

How do I block ChatGPT-User in robots.txt?

Add a group that names it: "User-agent: ChatGPT-User" on one line and "Disallow: /" on the next, in the robots.txt at the root of each host you want covered.

Does blocking ChatGPT-User remove my site from AI answers?

A robots.txt rule records your preference, but OpenAI does not commit to honouring it for user-initiated visits. A firewall or CDN rule that refuses the user agent stops the fetch itself. It does not remove you from ChatGPT search (that is OAI-SearchBot) and it does not change training (that is GPTBot).

Is ChatGPT-User a live crawler or a training crawler?

Live: it fetches pages to answer users now, which is the path to being cited. Does it follow robots.txt? Not reliably. OpenAI says that because these visits are started by a user, robots.txt rules may not apply.

How can I check whether my site blocks ChatGPT-User?

Run the free SEO Sets AI crawler check. It reads your robots.txt rules for this and nine other AI crawler tokens, and for real user agents it also requests your page with that name to see whether your server or CDN refuses it.

Official documentation

OpenAI: Overview of OpenAI crawlers. Facts on this page were read from it on November 17, 2026. Vendors change their crawlers; the vendor's page wins if it disagrees with ours.

Other OpenAI crawlers: OAI-SearchBot, GPTBot · All AI crawlers

See what to fix on your own site

The free Signal plan connects your Google Search Console and shows your top 3 pages with the most search upside, with no time limit and no credit card. AI citation tracking starts on Surge at $49 a month.

SEO Sets Support

Press Enter to send · Shift+Enter for new line