01 · Operator
Who operates DomainStatsBot
- Company
- DomainStats
- Type
- SEO tool crawler
- Official docs
- domainstats.com
02 · Behavior
What DomainStatsBot does
It fetches a domain's home page and up to 80 internal pages. It visits no more than once a month. It caches robots.txt and may fetch it some time before other pages.
03 · Impact
Why DomainStatsBot matters for your site
If you allow it
- Light crawl, at most once a month
- Respects robots.txt
- Verifiable by reverse DNS
If you block it
- Data serves a third-party SEO site
- Brings little direct traffic
04 · Allow
How to allow DomainStatsBot
robots.txt
User-agent: DomainStatsBot
Allow: /Cloudflare
# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "DomainStatsBot")
Action: Skip › All Super Bot Fight Mode rules
# Also check Security › Bots: "Block AI bots" can block it regardless of robots.txt.WordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: DomainStatsBot
Allow: /nginx
# nginx serves every user agent by default.
# Make sure no rule like this blocks it:
# if ($http_user_agent ~* "DomainStatsBot") { return 403; }Apache
# Apache serves every user agent by default.
# Make sure .htaccess has no rule like this:
# RewriteCond %{HTTP_USER_AGENT} DomainStatsBot [NC]
# RewriteRule .* - [F,L]05 · Block
How to block DomainStatsBot
DomainStatsBot follows robots.txt, so one rule is enough. Use a server or CDN rule only to stop spoofed copies.
robots.txt
User-agent: DomainStatsBot
Disallow: /Cloudflare
# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "DomainStatsBot")
Action: BlockWordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: DomainStatsBot
Disallow: /nginx
# In your server { } block:
if ($http_user_agent ~* "DomainStatsBot") {
return 403;
}Apache
# .htaccess
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} DomainStatsBot [NC]
RewriteRule .* - [F,L]
</IfModule>06 · User agents
User agents we see for DomainStatsBot
The user agent published by the operator:
DomainStatsBot/1.0 (https://domainstats.com/pages/our-bot)07 · Verification
Is it really DomainStatsBot?
Anyone can copy a user agent. A reverse DNS lookup of a real request resolves to bot.domainstats.com, and that hostname resolves back to the same IP.
FAQ
Questions about DomainStatsBot
How do I verify DomainStatsBot?
Run a reverse DNS lookup on the requesting IP. Genuine requests resolve to bot.domainstats.com.
How often does DomainStatsBot crawl?
DomainStats says it crawls the home page and up to 80 internal pages, no more than once a month.
How do I block DomainStatsBot?
Add "User-agent: DomainStatsBot" with "Disallow: /" to robots.txt. The bot follows robots.txt directives.
Last reviewed Oct 7, 2026