01 · Operator
Who operates linkdexbot
- Type
- SEO tool crawler
- Official docs
- linkdex.com
02 · Behavior
What linkdexbot does
Version 2.0 checks links between web pages to map backlinks. Version 2.1 crawls sites to find technical SEO issues. Version 2.2 checks the content of pages that rank in search engines.
03 · Impact
Why linkdexbot matters for your site
If you allow it
- Your site appears accurately in Linkdex SEO data
- Needed if you audit your own site with the tool
If you block it
- Data mainly serves third-party marketers
- Adds crawl load with no direct traffic
04 · Allow
How to allow linkdexbot
robots.txt
User-agent: linkdexbot
Allow: /Cloudflare
# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "linkdexbot")
Action: Skip › All Super Bot Fight Mode rules
# Also check Security › Bots: "Block AI bots" can block it regardless of robots.txt.WordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: linkdexbot
Allow: /nginx
# nginx serves every user agent by default.
# Make sure no rule like this blocks it:
# if ($http_user_agent ~* "linkdexbot") { return 403; }Apache
# Apache serves every user agent by default.
# Make sure .htaccess has no rule like this:
# RewriteCond %{HTTP_USER_AGENT} linkdexbot [NC]
# RewriteRule .* - [F,L]05 · Block
How to block linkdexbot
Start with robots.txt. If linkdexbot keeps showing up in your logs, block it at your CDN or web server.
robots.txt
User-agent: linkdexbot
Disallow: /Cloudflare
# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "linkdexbot")
Action: BlockWordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: linkdexbot
Disallow: /nginx
# In your server { } block:
if ($http_user_agent ~* "linkdexbot") {
return 403;
}Apache
# .htaccess
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} linkdexbot [NC]
RewriteRule .* - [F,L]
</IfModule>06 · User agents
User agents we see for linkdexbot
The user agent published by the operator:
Mozilla/5.0 (compatible; linkdexbot/2.2; +http://www.linkdex.com/bots/)07 · Verification
Is it really linkdexbot?
linkdexbot’s operator publishes no IP ranges or hostnames, so requests cannot be verified. Treat the user agent as a claim, and watch your logs for unusual request rates.
FAQ
Questions about linkdexbot
What is linkdexbot?
It is the crawler of the Linkdex SEO platform, operated by Analytics SEO Limited (Authoritas). It collects link, technical and ranking-page data.
Does linkdexbot follow robots.txt crawl limits?
Linkdex says it respects the crawl frequency limit set in your robots.txt file.
How do I block linkdexbot?
Add "User-agent: linkdexbot" followed by "Disallow: /" to your robots.txt file.
Last reviewed Oct 8, 2026