Agent reference · 50 user agents

Every AI agent, explained.

A reference for the AI user agents showing up in your logs: who runs each one, what it is doing on your site, whether you can trust it, and how to block it if you want to.

Browse

By what a visit means, or by who runs it

The kind tells you what a hit stands for: a reader, an index, or training data. The operator tells you whose robots.txt rules and IP lists apply.

Agents

Look up an agent

The operator, what a visit means, and whether a request can be checked against the IP addresses the operator publishes.

Directory

Every agent in the registry

All 50 user agents agenttraffic recognises, by operator. Linked names have a full write-up; the other 47 are being written a few at a time.

AgentOperatorKindVerifiable
AmazonbotAmazonTrainingby DNS
Claude CodeAnthropicLive fetchno
Claude-SearchBotAnthropicAI searchby IP
Claude-UserAnthropicLive fetchby IP
ClaudeBotAnthropicTrainingby IP
ApplebotAppleSearch engineby DNS
BaiduspiderBaiduSearch engineby DNS
BitlyBitlyLink unfurlno
BytespiderByteDanceTrainingno
cohere-aiCohereTrainingno
CCBotCommon CrawlTrainingno
DiffbotDiffbotTrainingno
DiscordDiscordLink unfurlno
DuckAssistBotDuckDuckGoAI searchno
DuckDuckBotDuckDuckGoSearch engineno
EmbedlyEmbedlyLink unfurlno
Chrome Prefetch ProxyGoogleOperationalno
Google-AgentGoogleLive fetchby IP
Google-CloudVertexBotGoogleAI searchby IP
Google-GeminiNotebookGoogleLive fetchby IP
Google-NotebookLMGoogleLive fetchno
GooglebotGoogleSearch engineby IP
GoogleOtherGoogleTrainingby IP
PetalBotHuaweiSearch engineby DNS
IframelyIframelyLink unfurlno
FacebookBotMetaTrainingno
Meta-ExternalAgentMetaTrainingno
Meta-ExternalFetcherMetaLive fetchno
meta-webindexerMetaAI searchno
WhatsAppMetaLink unfurlno
Facebook / iMessageMeta / AppleLink unfurlno
bingbotMicrosoftSearch engineby IP
BingPreviewMicrosoftSearch engineno
LinkedInMicrosoftLink unfurlno
SkypeMicrosoftLink unfurlno
MistralAI-UserMistralLive fetchno
ChatGPT-UserOpenAILive fetchby IP
GPTBotOpenAITrainingby IP
OAI-AdsBotOpenAIOperationalby IP
OAI-SearchBotOpenAIAI searchby IP
Perplexity-UserPerplexityLive fetchby IP
PerplexityBotPerplexityAI searchby IP
PinterestPinterestLink unfurlno
RedditRedditLink unfurlno
SlackSlackLink unfurlno
TelegramTelegramLink unfurlno
MCP fetch servervariousLive fetchno
VKVKLink unfurlno
YandexBotYandexSearch engineby DNS
YouBotYou.comAI searchno

Sources

Open data you can check

Every fact on this page is read from the agenttraffic registry, a versioned JSON file in the open-source repo. IP ranges are the lists the operators publish themselves, snapshotted on the date shown. Nothing here is scraped or guessed.

See it in your logs

One command, nothing to install

Point it at CloudFront, nginx or Apache logs. Every agent on this page gets its own row, with verified, spoofed and unchecked counts kept apart.

$ npx agenttraffic ./logs --days 7Quick start

Roadmap

Get a weekly report in your inbox

The command-line tool is free and stays free. A hosted version that emails you each week is on the roadmap. Leave your email and you'll hear once, when it exists.