Log in
Sign up with Google

AI search crawler · DuckDuckGo

DuckAssistBot is DuckDuckGo’s AI search crawler

DuckAssistBot is DuckDuckGo's crawler that fetches pages for answers generated by DuckAssist, which cites its sources.

Verifiable operator Respects robots.txt

Our take

Allow

It fetches pages for cited DuckAssist answers and the data is not used for training.

User agent

DuckAssistBot/1.2; (+http://duckduckgo.com/duckassistbot.html)

Activity

DuckAssistBot is crawling at a steady rate

Requests per site per dayLAST 28 DAYS
Sep 28Oct 7Oct 16Oct 25
What it crawls30 DAYS
  • Content pages 96%
  • Not found (404) 2.3%
  • Home page 1.3%
  • Other 0.1%

01 · Operator

Who operates DuckAssistBot

Company
DuckDuckGo
Official docs
duckduckgo.com

02 · Behavior

What DuckAssistBot does

DuckAssistBot crawls pages in real time to produce DuckAssist answers in DuckDuckGo Search. DuckDuckGo states the data is not used to train AI models. Disallowing it in robots.txt takes effect after 72 hours.

03 · Impact

Why DuckAssistBot matters for your site

If you allow it

  • Your pages can be cited as sources in DuckAssist answers
  • DuckDuckGo says the data is not used for AI training

If you block it

  • Removes your site as a source for DuckAssist answers
  • Reduces crawl load

04 · Allow

How to allow DuckAssistBot

robots.txt

User-agent: DuckAssistBot
Allow: /

Cloudflare

# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "DuckAssistBot")
Action:     Skip › All Super Bot Fight Mode rules

# Also check Security › Bots: "Block AI bots" can block it regardless of robots.txt.

WordPress

# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: DuckAssistBot
Allow: /

nginx

# nginx serves every user agent by default.
# Make sure no rule like this blocks it:
# if ($http_user_agent ~* "DuckAssistBot") { return 403; }

Apache

# Apache serves every user agent by default.
# Make sure .htaccess has no rule like this:
# RewriteCond %{HTTP_USER_AGENT} DuckAssistBot [NC]
# RewriteRule .* - [F,L]

05 · Block

How to block DuckAssistBot

DuckAssistBot follows robots.txt, so one rule is enough. Use a server or CDN rule only to stop spoofed copies.

robots.txt

User-agent: DuckAssistBot
Disallow: /

Cloudflare

# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "DuckAssistBot")
Action:     Block

WordPress

# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: DuckAssistBot
Disallow: /

nginx

# In your server { } block:
if ($http_user_agent ~* "DuckAssistBot") {
    return 403;
}

Apache

# .htaccess
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} DuckAssistBot [NC]
RewriteRule .* - [F,L]
</IfModule>

06 · User agents

User agents we see for DuckAssistBot

User agentShareLast activeStatus
DuckAssistBot/1.2; (+http://duckduckgo.com/duckassistbot.html) 81% Yesterday Verified
DuckAssistBot/1.1 (https://duckduckgo.com/duckassistbot) 18% 2 days ago Spoofed
DuckAssistBot/1.2; (+http://duckduckgo.com/duckassistbot.html) 0.2% 5 days ago Spoofed

07 · Verification

Is it really DuckAssistBot?

DuckAssistBot’s operator publishes no IP ranges or hostnames, so requests cannot be verified. Treat the user agent as a claim, and watch your logs for unusual request rates.

IP addresses we saw from verified DuckAssistBot requests

IP rangeShareLast active
51.8.71.117/32 24% Yesterday
172.169.17.165/32 17% Yesterday
20.3.1.178/32 15% Yesterday
108.141.83.74/32 12% Yesterday
4.209.224.56/32 11% Yesterday
4.213.46.14/32 6.0% Yesterday
20.195.108.47/32 5.0% 2 days ago
4.195.133.120/32 0.8% 4 days ago
64.236.15.33/32 0.7% 3 days ago
172.169.181.237/32 0.5% 16 days ago

Top 10 of 40 ranges. Always check against the operator’s current list; ranges change.

FAQ

Questions about DuckAssistBot

Is DuckAssistBot used to train AI?

No. DuckDuckGo states the data DuckAssistBot collects is not used in any way to train AI models.

How long does it take for a robots.txt block on DuckAssistBot to work?

DuckDuckGo says the change takes effect after 72 hours.

Where can I find DuckAssistBot's IP addresses?

DuckDuckGo lists them on its DuckAssistBot help page; it does not publish a separate JSON file there.

Last updated Oct 25, 2026

Your site

See which pages DuckAssistBot crawls on your website

Log Hero reads your server logs and shows every AI bot, every page, every day.

Sign up with Google

Free during early access