Google-GeminiNotebook
Google-GeminiNotebook (formerly NotebookLM): why it fetches your pages
Google-GeminiNotebook, formerly Google-NotebookLM, fetches pages people add as sources in Gemini Notebook. Here's what it does, robots.txt and verification.
Search engine crawler
Googlebot is Google's main crawler. It reads pages to build the Google Search index, which also feeds products such as Images, Video, News and Discover.
Google says its crawlers always obey robots.txt rules when crawling automatically.
User-agent: Googlebot Allow: /
Sill Agent Intelligence
Google-GeminiNotebook
Google-GeminiNotebook, formerly Google-NotebookLM, fetches pages people add as sources in Gemini Notebook. Here's what it does, robots.txt and verification.
Signed agents
Cloudflare verified bots and signed agents explained: the July 2026 change, Direct vs Intermediary, and how to see and control these bots in Cloudflare.
reverse DNS
Verify AI bots by IP range and reverse DNS: the official IP lists and DNS checks for OpenAI, Anthropic, Google, Perplexity, Bing, Apple, Amazon and more.
Almost never, unless you want your pages out of Google Search. Blocking it removes you from the index that powers Search.
Google says to check the IP against its published ranges and confirm the reverse DNS hostname ends in googlebot.com or geo.googlebot.com.