AI agents
Is your website ready for AI agents? A 2026 checklist
Is your website ready for AI agents? A 2026 checklist for store and business owners: access, readable pages, agent files, verification and order rules.
Fetches pages for a user
Google-Agent is used by AI agents hosted on Google infrastructure to navigate the web and perform actions when a user asks. Google lists it among its user-triggered fetchers, and is testing Web Bot Auth signatures for some of its requests.
Google says that because a user requested the fetch, its user-triggered fetchers generally ignore robots.txt rules. Google makes no separate statement for Google-Agent.
Sill does not publish website figures for Google-Agent.
AI agents
Is your website ready for AI agents? A 2026 checklist for store and business owners: access, readable pages, agent files, verification and order rules.
Web Bot Auth
Is Web Bot Auth a standard yet? Where the IETF Web Bot Auth working group stands in late 2026: the current draft, missed milestones and what changed.
Cloudflare
How to allow AI agents like ChatGPT agent through Cloudflare: find what is blocked, allow verified agents, add skip rules, and keep bad bots out.
It visits because a real person asked a Google-hosted agent to do something on your site, so blocking it can turn away customers. Google says user-triggered fetchers generally ignore robots.txt, so if you need a block, use firewall rules matched to Google's user-triggered-agents.json IP list.
No. Google says only a subset of Google-Agent requests are signed with Web Bot Auth while it experiments, and tells site owners to fall back to IP-based verification for the rest.