01 · Operator
Who operates AffsignalCrawler
- Company
- Affsignal
- Type
- Other bot
- Official docs
- affsignal.com
02 · Behavior
What AffsignalCrawler does
It finds public affiliate links and monetization patterns on websites. The data builds Affsignal's dataset of affiliate sites and networks. It checks robots.txt and skips sites that disallow it.
03 · Impact
Why AffsignalCrawler matters for your site
If you allow it
- Respects robots.txt
- Identifies itself honestly
If you block it
- Commercial data collection
- No traffic benefit
04 · Allow
How to allow AffsignalCrawler
robots.txt
User-agent: AffsignalCrawler
Allow: /Cloudflare
# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "AffsignalCrawler")
Action: Skip › All Super Bot Fight Mode rules
# Also check Security › Bots: "Block AI bots" can block it regardless of robots.txt.WordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: AffsignalCrawler
Allow: /nginx
# nginx serves every user agent by default.
# Make sure no rule like this blocks it:
# if ($http_user_agent ~* "AffsignalCrawler") { return 403; }Apache
# Apache serves every user agent by default.
# Make sure .htaccess has no rule like this:
# RewriteCond %{HTTP_USER_AGENT} AffsignalCrawler [NC]
# RewriteRule .* - [F,L]05 · Block
How to block AffsignalCrawler
AffsignalCrawler follows robots.txt, so one rule is enough. Use a server or CDN rule only to stop spoofed copies.
robots.txt
User-agent: AffsignalCrawler
Disallow: /Cloudflare
# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "AffsignalCrawler")
Action: BlockWordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: AffsignalCrawler
Disallow: /nginx
# In your server { } block:
if ($http_user_agent ~* "AffsignalCrawler") {
return 403;
}Apache
# .htaccess
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} AffsignalCrawler [NC]
RewriteRule .* - [F,L]
</IfModule>06 · User agents
User agents we see for AffsignalCrawler
The user agent published by the operator:
Mozilla/5.0 (compatible; AffsignalCrawler/1.0; +https://affsignal.com/bot)07 · Verification
Is it really AffsignalCrawler?
AffsignalCrawler’s operator publishes no IP ranges or hostnames, so requests cannot be verified. Treat the user agent as a claim, and watch your logs for unusual request rates.
FAQ
Questions about AffsignalCrawler
What is AffsignalCrawler?
It is Affsignal's crawler that maps affiliate links and monetization on websites.
How do I block AffsignalCrawler?
Add "User-agent: AffsignalCrawler" with "Disallow: /" to robots.txt, or email info@affsignal.com.
Last reviewed Oct 7, 2026