01 · Operator
Who operates BacklinkCrawler
- Company
- Backlinktest.com
- Type
- SEO tool crawler
- Official docs
- backlinktest.com
02 · Behavior
What BacklinkCrawler does
The crawler fetches pages and records the links between websites. The data feeds a backlink checking service. Its user agent points to backlinktest.com/crawler.html. No current documentation on crawl rules or IP addresses was found.
03 · Impact
Why BacklinkCrawler matters for your site
If you allow it
- Your links may appear in its backlink reports
- Light SEO data crawler
If you block it
- No direct traffic or visibility benefit
- Unclear whether the service is still active
- No way to verify its IP addresses
04 · Allow
How to allow BacklinkCrawler
robots.txt
User-agent: BacklinkCrawler
Allow: /Cloudflare
# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "BacklinkCrawler")
Action: Skip › All Super Bot Fight Mode rules
# Also check Security › Bots: "Block AI bots" can block it regardless of robots.txt.WordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: BacklinkCrawler
Allow: /nginx
# nginx serves every user agent by default.
# Make sure no rule like this blocks it:
# if ($http_user_agent ~* "BacklinkCrawler") { return 403; }Apache
# Apache serves every user agent by default.
# Make sure .htaccess has no rule like this:
# RewriteCond %{HTTP_USER_AGENT} BacklinkCrawler [NC]
# RewriteRule .* - [F,L]05 · Block
How to block BacklinkCrawler
Start with robots.txt. If BacklinkCrawler keeps showing up in your logs, block it at your CDN or web server.
robots.txt
User-agent: BacklinkCrawler
Disallow: /Cloudflare
# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "BacklinkCrawler")
Action: BlockWordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: BacklinkCrawler
Disallow: /nginx
# In your server { } block:
if ($http_user_agent ~* "BacklinkCrawler") {
return 403;
}Apache
# .htaccess
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} BacklinkCrawler [NC]
RewriteRule .* - [F,L]
</IfModule>06 · User agents
User agents we see for BacklinkCrawler
The user agent published by the operator:
BacklinkCrawler (http://www.backlinktest.com/crawler.html)07 · Verification
Is it really BacklinkCrawler?
BacklinkCrawler’s operator publishes no IP ranges or hostnames, so requests cannot be verified. Treat the user agent as a claim, and watch your logs for unusual request rates.
FAQ
Questions about BacklinkCrawler
What is BacklinkCrawler?
It is the backlink analysis crawler of Backlinktest.com. Its user agent links to backlinktest.com/crawler.html.
How do I block BacklinkCrawler?
Add 'User-agent: BacklinkCrawler' and 'Disallow: /' to robots.txt. Whether it obeys is not documented, so a server rule is safer.
Is BacklinkCrawler still active?
We found no current documentation for it. Recent traffic with this name may come from other software using the same string.
Last reviewed Oct 7, 2026