01 · Operator
Who operates uCrawlr
- Company
- Ucoz Media LLC
- Type
- Other bot
- Official docs
- blog.ucoz.ru
02 · Behavior
What uCrawlr does
The linked policy page says the server visits sites only to collect statistical information for marketing. It publishes no IP list and does not mention robots.txt.
03 · Impact
Why uCrawlr matters for your site
If you allow it
- Reads public pages only, according to its policy
- Operator publishes a contact address
If you block it
- Brings no visitors or search visibility
- No documented robots.txt support or IP list
04 · Allow
How to allow uCrawlr
robots.txt
User-agent: uCrawlr
Allow: /Cloudflare
# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "uCrawlr")
Action: Skip › All Super Bot Fight Mode rules
# Also check Security › Bots: "Block AI bots" can block it regardless of robots.txt.WordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: uCrawlr
Allow: /nginx
# nginx serves every user agent by default.
# Make sure no rule like this blocks it:
# if ($http_user_agent ~* "uCrawlr") { return 403; }Apache
# Apache serves every user agent by default.
# Make sure .htaccess has no rule like this:
# RewriteCond %{HTTP_USER_AGENT} uCrawlr [NC]
# RewriteRule .* - [F,L]05 · Block
How to block uCrawlr
Start with robots.txt. If uCrawlr keeps showing up in your logs, block it at your CDN or web server.
robots.txt
User-agent: uCrawlr
Disallow: /Cloudflare
# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "uCrawlr")
Action: BlockWordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: uCrawlr
Disallow: /nginx
# In your server { } block:
if ($http_user_agent ~* "uCrawlr") {
return 403;
}Apache
# .htaccess
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} uCrawlr [NC]
RewriteRule .* - [F,L]
</IfModule>06 · User agents
User agents we see for uCrawlr
The user agent published by the operator:
Mozilla/5.0 (compatible; uCrawlr/1.0 ; +https://blog.ucoz.ru/upolicy)07 · Verification
Is it really uCrawlr?
uCrawlr’s operator publishes no IP ranges or hostnames, so requests cannot be verified. Treat the user agent as a claim, and watch your logs for unusual request rates.
Last reviewed Oct 8, 2026