01 · Operator
Who operates Storebot-Google
- Company
- Official docs
- developers.google.com
02 · Behavior
What Storebot-Google does
Storebot-Google crawls pages for Google Shopping surfaces, such as the Shopping tab in Google Search. Google documents desktop and mobile user agents for it. Rules addressed to Storebot-Google affect all Google Shopping surfaces.
03 · Impact
Why Storebot-Google matters for your site
If you allow it
- Lets your products appear on Google Shopping surfaces
- It obeys robots.txt and can be verified by IP and reverse DNS
If you block it
- Not needed if you do not sell products online
- Adds crawl load on large product catalogs
04 · Allow
How to allow Storebot-Google
robots.txt
User-agent: Storebot-Google
Allow: /Cloudflare
# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "Storebot-Google")
Action: Skip › All Super Bot Fight Mode rules
# Also check Security › Bots: "Block AI bots" can block it regardless of robots.txt.WordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: Storebot-Google
Allow: /nginx
# nginx serves every user agent by default.
# Make sure no rule like this blocks it:
# if ($http_user_agent ~* "Storebot\-Google") { return 403; }Apache
# Apache serves every user agent by default.
# Make sure .htaccess has no rule like this:
# RewriteCond %{HTTP_USER_AGENT} Storebot\-Google [NC]
# RewriteRule .* - [F,L]05 · Block
How to block Storebot-Google
Storebot-Google follows robots.txt, so one rule is enough. Use a server or CDN rule only to stop spoofed copies.
robots.txt
User-agent: Storebot-Google
Disallow: /Cloudflare
# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "Storebot-Google")
Action: BlockWordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: Storebot-Google
Disallow: /nginx
# In your server { } block:
if ($http_user_agent ~* "Storebot\-Google") {
return 403;
}Apache
# .htaccess
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} Storebot\-Google [NC]
RewriteRule .* - [F,L]
</IfModule>06 · User agents
User agents we see for Storebot-Google
The user agent published by the operator:
Mozilla/5.0 (X11; Linux x86_64; Storebot-Google/1.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Safari/537.3607 · Verification
Is it really Storebot-Google?
Anyone can copy a user agent. Real Storebot-Google requests come from the IP ranges published at developers.google.com/static/crawling/ipranges/common-crawlers.json. A reverse DNS lookup of a real request resolves to googlebot.com</code>, <code>geo.googlebot.com, and that hostname resolves back to the same IP.
FAQ
Questions about Storebot-Google
What is Storebot-Google?
Storebot-Google is Google's crawler for Google Shopping. Its robots.txt rules apply to all Google Shopping surfaces.
Does Storebot-Google respect robots.txt?
Yes. Google says its common crawlers always obey robots.txt when crawling automatically. Use the token Storebot-Google.
What happens if I block Storebot-Google?
Google says crawling preferences for Storebot-Google affect all Google Shopping surfaces. Blocking it can limit how your products appear there.
Last reviewed Oct 8, 2026