Log in
Sign up with Google

Search engine crawler · DuckDuckGo

DuckDuckBot is DuckDuckGo’s search engine crawler

DuckDuckBot is the web crawler of the DuckDuckGo search engine.

Verifiable operator Respects robots.txt

Our take

Allow

It is a search engine crawler that follows robots.txt and publishes its IP addresses.

User agent

DuckDuckBot/1.1; (+http://duckduckgo.com/duckduckbot.html)

Activity

DuckDuckBot is crawling at a steady rate

Requests per site per dayLAST 28 DAYS
Sep 30Oct 9Oct 18Oct 27
What it crawls30 DAYS
  • Content pages 92%
  • Not found (404) 5.5%
  • Home page 1.9%
  • Images & assets 1.2%

01 · Operator

Who operates DuckDuckBot

Company
DuckDuckGo
Official docs
duckduckgo.com

02 · Behavior

What DuckDuckBot does

DuckDuckBot crawls web pages to improve DuckDuckGo search results. DuckDuckGo states that it respects robots.txt rules. Its help page lists the IP addresses it crawls from.

03 · Impact

Why DuckDuckBot matters for your site

If you allow it

  • Your pages can appear in DuckDuckGo results
  • Brings traffic from privacy-focused users
  • Honors robots.txt

If you block it

  • Adds crawl load if you do not care about DuckDuckGo traffic

04 · Allow

How to allow DuckDuckBot

robots.txt

User-agent: DuckDuckBot
Allow: /

Cloudflare

# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "DuckDuckBot")
Action:     Skip › All Super Bot Fight Mode rules

# Also check Security › Bots: "Block AI bots" can block it regardless of robots.txt.

WordPress

# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: DuckDuckBot
Allow: /

nginx

# nginx serves every user agent by default.
# Make sure no rule like this blocks it:
# if ($http_user_agent ~* "DuckDuckBot") { return 403; }

Apache

# Apache serves every user agent by default.
# Make sure .htaccess has no rule like this:
# RewriteCond %{HTTP_USER_AGENT} DuckDuckBot [NC]
# RewriteRule .* - [F,L]

05 · Block

How to block DuckDuckBot

DuckDuckBot follows robots.txt, so one rule is enough. Use a server or CDN rule only to stop spoofed copies.

robots.txt

User-agent: DuckDuckBot
Disallow: /

Cloudflare

# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "DuckDuckBot")
Action:     Block

WordPress

# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: DuckDuckBot
Disallow: /

nginx

# In your server { } block:
if ($http_user_agent ~* "DuckDuckBot") {
    return 403;
}

Apache

# .htaccess
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} DuckDuckBot [NC]
RewriteRule .* - [F,L]
</IfModule>

06 · User agents

User agents we see for DuckDuckBot

User agentShareLast activeStatus
DuckDuckBot/1.0; (+http://duckduckgo.com/duckduckbot.html) 98% Yesterday Verified
DuckDuckBot/1.1; (+http://duckduckgo.com/duckduckbot.html) 1.7% 2 days ago Verified

07 · Verification

Is it really DuckDuckBot?

DuckDuckBot’s operator publishes no IP ranges or hostnames, so requests cannot be verified. Treat the user agent as a claim, and watch your logs for unusual request rates.

IP addresses we saw from verified DuckDuckBot requests

IP rangeShareLast active
20.59.0.65/32 3.6% 2 days ago
48.206.18.152/32 3.3% Yesterday
40.65.78.86/32 2.9% 2 days ago
51.8.31.28/32 2.9% 3 days ago
20.80.120.41/32 2.9% 2 days ago
134.33.207.189/32 2.8% 2 days ago
20.85.138.75/32 2.8% 6 days ago
20.109.129.162/32 2.7% 2 days ago
20.118.11.251/32 2.7% 2 days ago
20.109.130.190/32 2.7% 2 days ago

Top 10 of 42 ranges. Always check against the operator’s current list; ranges change.

FAQ

Questions about DuckDuckBot

What is DuckDuckBot?

DuckDuckBot is the crawler DuckDuckGo uses to improve its search results.

Does DuckDuckBot respect robots.txt?

Yes. DuckDuckGo states that DuckDuckBot respects robots.txt rules.

How do I verify DuckDuckBot?

Compare the request IP with the list of addresses on DuckDuckGo's DuckDuckBot help page.

Last updated Oct 27, 2026

Your site

See which pages DuckDuckBot crawls on your website

Log Hero reads your server logs and shows every AI bot, every page, every day.

Sign up with Google

Free during early access