01 · Operator
Who operates INETDEX-BOT
- Company
- INETDEX
- Type
- Other bot
- Official docs
- inetdex.com
02 · Behavior
What INETDEX-BOT does
The bot automatically discovers and visits publicly accessible web pages. INETDEX says it collects them for indexing and technical analysis. Its bot page does not describe robots.txt compliance or publish IP addresses.
03 · Impact
Why INETDEX-BOT matters for your site
If you allow it
- Documented crawler with a public bot page
- Light indexing of public pages
If you block it
- No documented benefit to site owners
- robots.txt compliance is not stated
04 · Allow
How to allow INETDEX-BOT
robots.txt
User-agent: inetdex-bot
Allow: /Cloudflare
# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "inetdex-bot")
Action: Skip › All Super Bot Fight Mode rules
# Also check Security › Bots: "Block AI bots" can block it regardless of robots.txt.WordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: inetdex-bot
Allow: /nginx
# nginx serves every user agent by default.
# Make sure no rule like this blocks it:
# if ($http_user_agent ~* "inetdex\-bot") { return 403; }Apache
# Apache serves every user agent by default.
# Make sure .htaccess has no rule like this:
# RewriteCond %{HTTP_USER_AGENT} inetdex\-bot [NC]
# RewriteRule .* - [F,L]05 · Block
How to block INETDEX-BOT
Start with robots.txt. If INETDEX-BOT keeps showing up in your logs, block it at your CDN or web server.
robots.txt
User-agent: inetdex-bot
Disallow: /Cloudflare
# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "inetdex-bot")
Action: BlockWordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: inetdex-bot
Disallow: /nginx
# In your server { } block:
if ($http_user_agent ~* "inetdex\-bot") {
return 403;
}Apache
# .htaccess
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} inetdex\-bot [NC]
RewriteRule .* - [F,L]
</IfModule>06 · User agents
User agents we see for INETDEX-BOT
The user agent published by the operator:
inetdex-bot/2.007 · Verification
Is it really INETDEX-BOT?
INETDEX-BOT’s operator publishes no IP ranges or hostnames, so requests cannot be verified. Treat the user agent as a claim, and watch your logs for unusual request rates.
FAQ
Questions about INETDEX-BOT
What is INETDEX-BOT?
It is the crawler of INETDEX. It visits public web pages for indexing and technical analysis.
How do I block INETDEX-BOT?
INETDEX says access can be restricted at the web server, firewall or application level. You can also add a robots.txt rule, but compliance is not documented.
Does INETDEX-BOT respect robots.txt?
Its bot page does not state a robots.txt policy.
Last reviewed Oct 8, 2026