Log in
Sign up with Google

Other bot · Profound Networks, LLC

DomainAppender is Profound Networks, LLC’s other bot

DomainAppender is a crawler of Profound Networks. It matches company names and addresses to the correct business website.

Respects robots.txt

Our take

Your call

It is a commercial data crawler that respects robots.txt but sends no visitors.

User agent

Mozilla/5.0 (compatible; DomainAppender /1.0; +http://www.profound.net/domainappender)

01 · Operator

Who operates DomainAppender

Type
Other bot
Official docs
profound.net

02 · Behavior

What DomainAppender does

Clients supply company names and addresses. DomainAppender checks candidate websites to find the matching business domain. It revisits candidate sites to see if anything has changed.

03 · Impact

Why DomainAppender matters for your site

If you allow it

  • Helps business databases list your correct website
  • Respects robots.txt

If you block it

  • Commercial data enrichment, not search traffic
  • No published verification method

04 · Allow

How to allow DomainAppender

robots.txt

User-agent: DomainAppender
Allow: /

Cloudflare

# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "DomainAppender")
Action:     Skip › All Super Bot Fight Mode rules

# Also check Security › Bots: "Block AI bots" can block it regardless of robots.txt.

WordPress

# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: DomainAppender
Allow: /

nginx

# nginx serves every user agent by default.
# Make sure no rule like this blocks it:
# if ($http_user_agent ~* "DomainAppender") { return 403; }

Apache

# Apache serves every user agent by default.
# Make sure .htaccess has no rule like this:
# RewriteCond %{HTTP_USER_AGENT} DomainAppender [NC]
# RewriteRule .* - [F,L]

05 · Block

How to block DomainAppender

DomainAppender follows robots.txt, so one rule is enough. Use a server or CDN rule only to stop spoofed copies.

robots.txt

User-agent: DomainAppender
Disallow: /

Cloudflare

# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "DomainAppender")
Action:     Block

WordPress

# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: DomainAppender
Disallow: /

nginx

# In your server { } block:
if ($http_user_agent ~* "DomainAppender") {
    return 403;
}

Apache

# .htaccess
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} DomainAppender [NC]
RewriteRule .* - [F,L]
</IfModule>

06 · User agents

User agents we see for DomainAppender

The user agent published by the operator:

Mozilla/5.0 (compatible; DomainAppender /1.0; +http://www.profound.net/domainappender)

07 · Verification

Is it really DomainAppender?

DomainAppender’s operator publishes no IP ranges or hostnames, so requests cannot be verified. Treat the user agent as a claim, and watch your logs for unusual request rates.

FAQ

Questions about DomainAppender

What is DomainAppender?

It is a Profound Networks service that links company names and addresses to the correct business website.

Does DomainAppender respect robots.txt?

Yes. Its documentation states that DomainAppender respects robots.txt.

How do I block DomainAppender?

Add a robots.txt group for User-agent: DomainAppender with Disallow: /.

Last reviewed Oct 7, 2026

Your site

See which pages DomainAppender crawls on your website

Log Hero reads your server logs and shows every AI bot, every page, every day.

Sign up with Google

Free during early access