01 · Operator
Who operates Amazonbot
- Company
- Amazon
- Type
- AI training crawler
- Official docs
- developer.amazon.com
02 · Behavior
What Amazonbot does
Amazonbot crawls pages automatically to improve Amazon products and services, and the data may be used to train Amazon AI models. It is not triggered by users; Amazon uses Amzn-SearchBot for search and Amzn-User for user requests. It follows robots.txt allow/disallow rules and the noarchive meta tag, but not Crawl-delay.
03 · Impact
Why Amazonbot matters for your site
If you allow it
- Content may improve Amazon products and services
- You can opt out of model training per page with the noarchive meta tag
If you block it
- Data may be used to train Amazon AI models
- Does not support Crawl-delay to limit load
- No documented referral traffic
04 · Allow
How to allow Amazonbot
robots.txt
User-agent: Amazonbot
Allow: /Cloudflare
# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "Amazonbot")
Action: Skip › All Super Bot Fight Mode rules
# Also check Security › Bots: "Block AI bots" can block it regardless of robots.txt.WordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: Amazonbot
Allow: /nginx
# nginx serves every user agent by default.
# Make sure no rule like this blocks it:
# if ($http_user_agent ~* "Amazonbot") { return 403; }Apache
# Apache serves every user agent by default.
# Make sure .htaccess has no rule like this:
# RewriteCond %{HTTP_USER_AGENT} Amazonbot [NC]
# RewriteRule .* - [F,L]05 · Block
How to block Amazonbot
Amazonbot follows robots.txt, so one rule is enough. Use a server or CDN rule only to stop spoofed copies.
robots.txt
User-agent: Amazonbot
Disallow: /Cloudflare
# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "Amazonbot")
Action: BlockWordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: Amazonbot
Disallow: /nginx
# In your server { } block:
if ($http_user_agent ~* "Amazonbot") {
return 403;
}Apache
# .htaccess
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} Amazonbot [NC]
RewriteRule .* - [F,L]
</IfModule>06 · User agents
User agents we see for Amazonbot
| User agent | Share | Last active | Status |
|---|---|---|---|
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.ama… |
55% | Yesterday | Verified |
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.ama… |
45% | Yesterday | Spoofed |
Mozilla/5.0 (compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) |
0.5% | 2 days ago | Spoofed |
07 · Verification
Is it really Amazonbot?
Anyone can copy a user agent. Real Amazonbot requests come from the IP ranges published at developer.amazon.com/amazonbot/ip-addresses/.
IP addresses we saw from verified Amazonbot requests
| IP range | Share | Last active |
|---|---|---|
98.82.40.168 |
3.2% | Yesterday |
52.204.89.12 |
2.7% | Yesterday |
52.200.58.199 |
2.7% | Yesterday |
54.243.63.52 |
2.6% | Yesterday |
3.94.199.128 |
2.6% | Yesterday |
54.225.98.148 |
2.6% | Yesterday |
44.208.223.68 |
2.6% | Yesterday |
34.236.135.14 |
2.6% | Yesterday |
44.206.65.8 |
2.5% | Yesterday |
18.204.152.114 |
2.5% | Yesterday |
Top 10 of 40 ranges. Always check against the operator’s current list; ranges change.
FAQ
Questions about Amazonbot
Does Amazonbot support Crawl-delay?
No. Amazon states its crawlers honor robots.txt allow and disallow rules but do not support the Crawl-delay directive.
Can I stop Amazon from using my pages for AI training without blocking Amazonbot?
Amazon says its crawlers respect the noarchive robots meta tag, which means do not use the page for model training.
How do I verify Amazonbot?
Match the source IP against the list Amazon publishes at developer.amazon.com/amazonbot/ip-addresses/.
Last updated Oct 25, 2026