01 · Operator
Who operates Google-Extended
- Company
- Type
- AI training crawler
- Official docs
- developers.google.com
02 · Behavior
What Google-Extended does
Google-Extended is not a separate crawler and has no HTTP user agent string of its own; crawling is done by existing Google user agents. Publishers use the token in robots.txt to decide whether their content may be used for future Gemini models powering Gemini Apps and the Vertex AI API. It does not affect Google Search.
03 · Impact
Why Google-Extended matters for your site
If you allow it
- Your content can inform Gemini models
- No effect on Google Search inclusion or ranking either way
If you block it
- Keeps your content out of Gemini model training
- No effect on Google Search inclusion or ranking
04 · Allow
How to allow Google-Extended
robots.txt
User-agent: Google-Extended
Allow: /Cloudflare
# Google-Extended is a robots.txt token only. It never appears as a user agent,
# so server and CDN rules cannot match it. Use robots.txt instead.WordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: Google-Extended
Allow: /nginx
# Google-Extended is a robots.txt token only. It never appears as a user agent,
# so server and CDN rules cannot match it. Use robots.txt instead.Apache
# Google-Extended is a robots.txt token only. It never appears as a user agent,
# so server and CDN rules cannot match it. Use robots.txt instead.05 · Block
How to block Google-Extended
Google-Extended follows robots.txt, so one rule is enough. Use a server or CDN rule only to stop spoofed copies.
robots.txt
User-agent: Google-Extended
Disallow: /Cloudflare
# Google-Extended is a robots.txt token only. It never appears as a user agent,
# so server and CDN rules cannot match it. Use robots.txt instead.WordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: Google-Extended
Disallow: /nginx
# Google-Extended is a robots.txt token only. It never appears as a user agent,
# so server and CDN rules cannot match it. Use robots.txt instead.Apache
# Google-Extended is a robots.txt token only. It never appears as a user agent,
# so server and CDN rules cannot match it. Use robots.txt instead.FAQ
Questions about Google-Extended
Does blocking Google-Extended affect Google rankings?
No. Google states Google-Extended does not impact a site's inclusion in Google Search and is not used as a ranking signal.
Why don't I see Google-Extended in my server logs?
Google-Extended has no separate HTTP user agent string; it is only a robots.txt token applied to content fetched by other Google crawlers.
How do I block Google-Extended?
Add "User-agent: Google-Extended" followed by "Disallow: /" to robots.txt.
Last reviewed Oct 6, 2026