Log in
Sign up with Google

SEO tool crawler · Google

Google-Structured-Data-Testing-Tool was Google’s SEO tool crawler

Google-Structured-Data-Testing-Tool was the fetcher of Google's Structured Data Testing Tool. It loaded a page when a user tested its structured data markup.

Our take

Allow

It was a user-triggered testing tool that caused minimal load.

User agent

Mozilla/5.0 (compatible; Google-Structured-Data-Testing-Tool +https://search.google.com/structured-data/testing-tool)

01 · Operator

Who operates Google-Structured-Data-Testing-Tool

Company
Google
Official docs
developers.google.com

02 · Behavior

What Google-Structured-Data-Testing-Tool does

The tool fetched a URL that a user entered and checked its structured data markup. Requests were triggered by users, not by scheduled crawling. Its old URL now redirects to Google's structured data documentation.

03 · Impact

Why Google-Structured-Data-Testing-Tool matters for your site

If you allow it

  • Requests were made when someone tested your markup
  • Load was one page per test

If you block it

  • The tool's old URL now redirects, so current requests with this UA may be spoofed

04 · Allow

How to allow Google-Structured-Data-Testing-Tool

robots.txt

# Google-Structured-Data-Testing-Tool has no documented robots.txt token and does not read robots.txt.
# Use a Cloudflare, nginx or Apache rule instead.

Cloudflare

# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "Google-Structured-Data-Testing-Tool")
Action:     Skip › All Super Bot Fight Mode rules

# Also check Security › Bots: "Block AI bots" can block it regardless of robots.txt.

WordPress

# Google-Structured-Data-Testing-Tool has no documented robots.txt token and does not read robots.txt.
# Use a Cloudflare, nginx or Apache rule instead.

nginx

# nginx serves every user agent by default.
# Make sure no rule like this blocks it:
# if ($http_user_agent ~* "Google\-Structured\-Data\-Testing\-Tool") { return 403; }

Apache

# Apache serves every user agent by default.
# Make sure .htaccess has no rule like this:
# RewriteCond %{HTTP_USER_AGENT} Google\-Structured\-Data\-Testing\-Tool [NC]
# RewriteRule .* - [F,L]

05 · Block

How to block Google-Structured-Data-Testing-Tool

Start with robots.txt. If Google-Structured-Data-Testing-Tool keeps showing up in your logs, block it at your CDN or web server.

robots.txt

# Google-Structured-Data-Testing-Tool has no documented robots.txt token and does not read robots.txt.
# Use a Cloudflare, nginx or Apache rule instead.

Cloudflare

# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "Google-Structured-Data-Testing-Tool")
Action:     Block

WordPress

# Google-Structured-Data-Testing-Tool has no documented robots.txt token and does not read robots.txt.
# Use a Cloudflare, nginx or Apache rule instead.

nginx

# In your server { } block:
if ($http_user_agent ~* "Google\-Structured\-Data\-Testing\-Tool") {
    return 403;
}

Apache

# .htaccess
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} Google\-Structured\-Data\-Testing\-Tool [NC]
RewriteRule .* - [F,L]
</IfModule>

06 · User agents

User agents we see for Google-Structured-Data-Testing-Tool

The user agent published by the operator:

Mozilla/5.0 (compatible; Google-Structured-Data-Testing-Tool +https://search.google.com/structured-data/testing-tool)

07 · Verification

Is it really Google-Structured-Data-Testing-Tool?

Google-Structured-Data-Testing-Tool’s operator publishes no IP ranges or hostnames, so requests cannot be verified. Treat the user agent as a claim, and watch your logs for unusual request rates.

FAQ

Questions about Google-Structured-Data-Testing-Tool

What was the Google Structured Data Testing Tool?

It was a Google tool that fetched a page and checked its structured data markup. A user triggered each request.

Does the Structured Data Testing Tool still exist?

Its old URL now redirects to Google's structured data documentation. Google posted an update on the tool in December 2020.

Last updated Oct 14, 2026

Your site

See which pages Google-Structured-Data-Testing-Tool crawls on your website

Log Hero reads your server logs and shows every AI bot, every page, every day.

Sign up with Google

Free during early access