Log in
Sign up with Google

SEO tool crawler · XML-Sitemaps.com

XML Sitemaps Generator is XML-Sitemaps.com’s SEO tool crawler

XML Sitemaps Generator is the crawler of XML-Sitemaps.com, a free online tool that builds sitemaps for websites.

Our take

Your call

It is useful when you run it yourself, but third parties can also crawl your site with it.

User agent

Mozilla/5.0 (compatible; XML Sitemaps Generator; http://www.xml-sitemaps.com) Gecko XML-Sitemaps/1.0

01 · Operator

Who operates XML Sitemaps Generator

Official docs
xml-sitemaps.com

02 · Behavior

What XML Sitemaps Generator does

A user enters a website URL on xml-sitemaps.com. The crawler then visits that site and discovers its pages. The tool turns the result into XML, HTML or text sitemaps that the user can submit to search engines.

03 · Impact

Why XML Sitemaps Generator matters for your site

If you allow it

  • Usually started by you or your SEO team
  • Produces a sitemap of your own site

If you block it

  • Anyone can start a crawl of any site
  • Can request many pages in a short time

04 · Allow

How to allow XML Sitemaps Generator

robots.txt

User-agent: XML-Sitemaps
Allow: /

Cloudflare

# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "XML-Sitemaps")
Action:     Skip › All Super Bot Fight Mode rules

# Also check Security › Bots: "Block AI bots" can block it regardless of robots.txt.

WordPress

# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: XML-Sitemaps
Allow: /

nginx

# nginx serves every user agent by default.
# Make sure no rule like this blocks it:
# if ($http_user_agent ~* "XML\-Sitemaps") { return 403; }

Apache

# Apache serves every user agent by default.
# Make sure .htaccess has no rule like this:
# RewriteCond %{HTTP_USER_AGENT} XML\-Sitemaps [NC]
# RewriteRule .* - [F,L]

05 · Block

How to block XML Sitemaps Generator

Start with robots.txt. If XML Sitemaps Generator keeps showing up in your logs, block it at your CDN or web server.

robots.txt

User-agent: XML-Sitemaps
Disallow: /

Cloudflare

# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "XML-Sitemaps")
Action:     Block

WordPress

# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: XML-Sitemaps
Disallow: /

nginx

# In your server { } block:
if ($http_user_agent ~* "XML\-Sitemaps") {
    return 403;
}

Apache

# .htaccess
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} XML\-Sitemaps [NC]
RewriteRule .* - [F,L]
</IfModule>

06 · User agents

User agents we see for XML Sitemaps Generator

The user agent published by the operator:

Mozilla/5.0 (compatible; XML Sitemaps Generator; http://www.xml-sitemaps.com) Gecko XML-Sitemaps/1.0

07 · Verification

Is it really XML Sitemaps Generator?

XML Sitemaps Generator’s operator publishes no IP ranges or hostnames, so requests cannot be verified. Treat the user agent as a claim, and watch your logs for unusual request rates.

FAQ

Questions about XML Sitemaps Generator

What is XML Sitemaps Generator in my logs?

It is the crawler of xml-sitemaps.com. Someone entered your site URL into the online sitemap generator.

How do I block XML Sitemaps Generator?

Block the user agent string "XML-Sitemaps" on your server. The site does not document how it handles robots.txt.

Last reviewed Oct 8, 2026

Your site

See which pages XML Sitemaps Generator crawls on your website

Log Hero reads your server logs and shows every AI bot, every page, every day.

Sign up with Google

Free during early access