MegaIndex.ru Bot: What It Is & How to Block It

01 · Operator

Who operates MegaIndex.ru

Company: MegaIndex
Type: SEO tool crawler
Official docs: megaindex.com

02 · Behavior

What MegaIndex.ru does

MegaIndex.ru crawls websites for MegaIndex. Bot databases point to MegaIndex's link analysis feature. The crawler page it links to now describes a headless browser API.

03 · Impact

Why MegaIndex.ru matters for your site

If you allow it

Provides link data used by SEO professionals

If you block it

No direct traffic benefit
Feeds a commercial SEO product

04 · Allow

How to allow MegaIndex.ru

robots.txt

User-agent: MegaIndex.ru
Allow: /

Cloudflare

# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "MegaIndex.ru")
Action:     Skip › All Super Bot Fight Mode rules

# Also check Security › Bots: "Block AI bots" can block it regardless of robots.txt.

WordPress

# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: MegaIndex.ru
Allow: /

nginx

# nginx serves every user agent by default.
# Make sure no rule like this blocks it:
# if ($http_user_agent ~* "MegaIndex\.ru") { return 403; }

Apache

# Apache serves every user agent by default.
# Make sure .htaccess has no rule like this:
# RewriteCond %{HTTP_USER_AGENT} MegaIndex\.ru [NC]
# RewriteRule .* - [F,L]

05 · Block

How to block MegaIndex.ru

Start with robots.txt. If MegaIndex.ru keeps showing up in your logs, block it at your CDN or web server.

robots.txt

User-agent: MegaIndex.ru
Disallow: /

Cloudflare

# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "MegaIndex.ru")
Action:     Block

WordPress

# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: MegaIndex.ru
Disallow: /

nginx

# In your server { } block:
if ($http_user_agent ~* "MegaIndex\.ru") {
    return 403;
}

Apache

# .htaccess
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} MegaIndex\.ru [NC]
RewriteRule .* - [F,L]
</IfModule>

06 · User agents

User agents we see for MegaIndex.ru

The user agent published by the operator:

Mozilla/5.0 (compatible; MegaIndex.ru/2.0; +http://megaindex.com/crawler)

07 · Verification

Is it really MegaIndex.ru?

MegaIndex.ru’s operator publishes no IP ranges or hostnames, so requests cannot be verified. Treat the user agent as a claim, and watch your logs for unusual request rates.

FAQ

Questions about MegaIndex.ru

What is MegaIndex.ru bot?

It is the crawler of MegaIndex, an SEO service. Bot databases associate it with MegaIndex's link analysis tool.

How do I block MegaIndex.ru?

Add a robots.txt group for "MegaIndex.ru" with "Disallow: /", or block the user agent on your server.

MegaIndex.ru is MegaIndex’s SEO tool crawler