OpenAI crawlers and agents
OpenAI runs 3 user agents that agenttraffic recognises. They do different jobs and deserve different robots.txt decisions, which is why each has its own page.
- ChatGPT-UserOpenAI · Live fetch · IP ranges publishedChatGPT-User is the user agent OpenAI sends when a person asks ChatGPT about a specific page and ChatGPT fetches it on the spot.
- OAI-SearchBotOpenAI · AI search · IP ranges publishedOAI-SearchBot is the crawler that builds the search index behind ChatGPT search.
- GPTBotOpenAI · Training · IP ranges publishedGPTBot is OpenAI's training crawler.