01 · Operator
Who operates URLAppendBot
- Company
- Profound Networks
- Type
- Other bot
- Official docs
- profound.net
02 · Behavior
What URLAppendBot does
Profound Networks links company records to domains and tracks technographic signals. URLAppendBot visits websites to collect data for these products. Its former documentation page now returns an error.
03 · Impact
Why URLAppendBot matters for your site
If you allow it
- Can keep your company data accurate in B2B databases
If you block it
- Feeds a commercial data product
- No direct traffic benefit
- Documentation is no longer online
04 · Allow
How to allow URLAppendBot
robots.txt
User-agent: URLAppendBot
Allow: /Cloudflare
# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "URLAppendBot")
Action: Skip › All Super Bot Fight Mode rules
# Also check Security › Bots: "Block AI bots" can block it regardless of robots.txt.WordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: URLAppendBot
Allow: /nginx
# nginx serves every user agent by default.
# Make sure no rule like this blocks it:
# if ($http_user_agent ~* "URLAppendBot") { return 403; }Apache
# Apache serves every user agent by default.
# Make sure .htaccess has no rule like this:
# RewriteCond %{HTTP_USER_AGENT} URLAppendBot [NC]
# RewriteRule .* - [F,L]05 · Block
How to block URLAppendBot
Start with robots.txt. If URLAppendBot keeps showing up in your logs, block it at your CDN or web server.
robots.txt
User-agent: URLAppendBot
Disallow: /Cloudflare
# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "URLAppendBot")
Action: BlockWordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: URLAppendBot
Disallow: /nginx
# In your server { } block:
if ($http_user_agent ~* "URLAppendBot") {
return 403;
}Apache
# .htaccess
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} URLAppendBot [NC]
RewriteRule .* - [F,L]
</IfModule>06 · User agents
User agents we see for URLAppendBot
The user agent published by the operator:
Mozilla/5.0 (compatible; URLAppendBot/1.0; +http://www.profound.net/urlappendbot.html)07 · Verification
Is it really URLAppendBot?
URLAppendBot’s operator publishes no IP ranges or hostnames, so requests cannot be verified. Treat the user agent as a claim, and watch your logs for unusual request rates.
FAQ
Questions about URLAppendBot
Who runs URLAppendBot?
The user agent points to Profound Networks, a B2B data company that maps company records to domains.
Should I block URLAppendBot?
It is your call. It serves a commercial data product and brings no direct traffic.
Last reviewed Oct 8, 2026