AI agent traffic
How to see AI agent traffic your analytics misses
Why GA4 and other JavaScript analytics miss AI agent traffic, and how to see it in server logs, Cloudflare AI Crawl Control and referral reports.
Fetches pages for a user
Claude-User visits a website when a Claude user asks a question that needs it. It acts for that person at that moment.
Anthropic says its bots honor robots.txt, and that blocking Claude-User prevents retrieval of your content for user queries.
User-agent: Claude-User Allow: /
Sill Agent Intelligence
AI agent traffic
Why GA4 and other JavaScript analytics miss AI agent traffic, and how to see it in server logs, Cloudflare AI Crawl Control and referral reports.
reverse DNS
Verify AI bots by IP range and reverse DNS: the official IP lists and DNS checks for OpenAI, Anthropic, Google, Perplexity, Bing, Apple, Amazon and more.
Agent identity
AI agent identity explained for website owners: user agents, IP lists, reverse DNS, signed requests and verified bots, and how far to trust each one.
Anthropic says blocking it may reduce your visibility in user-directed web search. Allow it if you want Claude users to be able to read your pages.
Not necessarily. Anthropic's article only says an address on its list is from Anthropic; it does not say every request will be on it.