AgentsOpenAIGPTBot

What is GPTBot?

GPTBot is OpenAI's training crawler. It fetches pages on its own schedule to build datasets for training OpenAI's models. It is not the agent that fetches a page when someone asks ChatGPT about it (that is ChatGPT-User), and it is not the search indexer (that is OAI-SearchBot). A GPTBot hit is a crawl event, not a reader.

TrainingVerifiable by IProbots.txt: GPTBot

How it identifies itself

Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; GPTBot/1.0; +https://openai.com/gptbot
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; GPTBot/1.1; +https://openai.com/gptbot
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; GPTBot/1.2; +https://openai.com/gptbot

agenttraffic recognises it by the name GPTBot.

What it does

A training crawler collects pages to train models. Blocking it costs you no citations and no readers. More on training crawler agents.

Is it really them?

OpenAI publishes the IP addresses this agent uses (21 address ranges, list dated 2025-10-30, specific to GPTBot). agenttraffic checks every GPTBot request against them and reports it as verified, spoofed, or unchecked when the log has no client IP.

GPTBot is impersonated less often than ChatGPT-User because there is nothing to gain from looking like a training crawler, but SEO tools and log analysers still emit it during tests. The spoofed column catches those.

How to block it

In robots.txt it goes by GPTBot. Copy one of these:

# Allow
User-agent: GPTBot
Allow: /

# Block
User-agent: GPTBot
Disallow: /

What it means in your logs

GPTBot traffic is the one category on the report that carries no reader behind it. A person did not ask for your page; a scheduler did. agenttraffic therefore hides training crawlers from the default terminal report and shows them with --show-training, so the AI crawler section stays focused on fetches that map to people.

That does not make GPTBot uninteresting. Its page list tells you which of your content OpenAI considers worth collecting, and a sudden increase usually precedes a model training cycle. Sites that publish a lot of long-form text sometimes see GPTBot as their single largest bot by request count.

Where the verification data comes from

OpenAI publishes a list of IP addresses for GPTBot, separate from the ChatGPT-User and OAI-SearchBot lists. agenttraffic ships a dated snapshot and checks every GPTBot request against it. Because the list is small and specific, verification is reliable: a GPTBot name from an IP outside the list is almost always a tool pretending, and it lands in the spoofed column rather than being counted as OpenAI.

Blocking GPTBot

This is the one OpenAI agent where blocking costs nothing visible. Disallowing GPTBot in robots.txt removes your pages from future training crawls and leaves search citations and live fetches untouched, because those use different agents. OpenAI states that GPTBot honours the robots.txt name. If you want to opt out of training but stay reachable in ChatGPT answers, block GPTBot and allow OAI-SearchBot and ChatGPT-User.

Versions

The version number in the user agent string has moved from 1.0 through 1.2. agenttraffic matches on the GPTBot name, so every version is recognised without a registry change; the exact strings above are listed so you can grep for them directly.

Reading the page list

The pages GPTBot fetches are a rough proxy for what OpenAI's collection pipeline treats as text worth having. Long articles, documentation and reference pages dominate; app shells, login pages and paginated archives appear rarely. If a page you consider important never shows up, the usual causes are a robots.txt rule broader than intended, a noindex header (which GPTBot does not use, but which often travels with a disallow), or the page simply not being linked from anywhere GPTBot has already been. Fix the linking first; GPTBot discovers pages the same way search crawlers do.

Related agents

FAQ

Straight answers about GPTBot

What is GPTBot?

GPTBot is OpenAI's training crawler. It fetches pages on its own schedule to build datasets for training OpenAI's models. It is not the agent that fetches a page when someone asks ChatGPT about it (that is ChatGPT-User), and it is not the search indexer (that is OAI-SearchBot). A GPTBot hit is a crawl event, not a reader.

How do I know GPTBot traffic is really from OpenAI?

OpenAI publishes the IP addresses this agent uses (21 address ranges, list dated 2025-10-30, specific to GPTBot). agenttraffic checks every GPTBot request against them and reports it as verified, spoofed, or unchecked when the log has no client IP.

How do I block GPTBot in robots.txt?

Add "User-agent: GPTBot" followed by "Disallow: /". OpenAI documents this name. Whether it is honoured is up to OpenAI: robots.txt is a request their crawler chooses to follow, not something your server enforces.

Does blocking GPTBot affect ChatGPT citations?

No. Citations in ChatGPT come from OAI-SearchBot's index and from ChatGPT-User live fetches. Blocking GPTBot only opts your pages out of future training datasets.

How often does GPTBot crawl?

There is no published schedule. On the reference deployment it arrives in bursts, often re-fetching the same popular pages, and it respects crawl-delay hints in robots.txt according to OpenAI's documentation.

Published 2026-08-28, updated 2026-08-28. Facts come from the agenttraffic registry.

See it in your logs

One command, nothing to install

Point it at CloudFront, nginx or Apache logs. GPTBot gets its own row, with verified, spoofed and unchecked counts kept apart.

$ npx agenttraffic ./logs --days 7 --show-trainingQuick start

Roadmap

Get a weekly report in your inbox

The command-line tool is free and stays free. A hosted version that emails you each week is on the roadmap. Leave your email and you'll hear once, when it exists.