01 · Operator
Who operates Applebot-Extended
- Company
- Apple
- Type
- AI training crawler
- Official docs
- support.apple.com
02 · Behavior
What Applebot-Extended does
Applebot-Extended does not crawl web pages; Apple uses it only to decide how data already crawled by Applebot may be used. Disallowing it keeps your content out of training for Apple foundation models used in Apple Intelligence, Services and Developer Tools. Pages that disallow it can still appear in Apple search results.
03 · Impact
Why Applebot-Extended matters for your site
If you allow it
- Your content can inform Apple's foundation models
- No effect on Apple search visibility either way
If you block it
- Keeps your content out of Apple generative AI training
- Your pages still appear in Apple search results
04 · Allow
How to allow Applebot-Extended
robots.txt
User-agent: Applebot-Extended
Allow: /Cloudflare
# Applebot-Extended is a robots.txt token only. It never appears as a user agent,
# so server and CDN rules cannot match it. Use robots.txt instead.WordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: Applebot-Extended
Allow: /nginx
# Applebot-Extended is a robots.txt token only. It never appears as a user agent,
# so server and CDN rules cannot match it. Use robots.txt instead.Apache
# Applebot-Extended is a robots.txt token only. It never appears as a user agent,
# so server and CDN rules cannot match it. Use robots.txt instead.05 · Block
How to block Applebot-Extended
Applebot-Extended follows robots.txt, so one rule is enough. Use a server or CDN rule only to stop spoofed copies.
robots.txt
User-agent: Applebot-Extended
Disallow: /Cloudflare
# Applebot-Extended is a robots.txt token only. It never appears as a user agent,
# so server and CDN rules cannot match it. Use robots.txt instead.WordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: Applebot-Extended
Disallow: /nginx
# Applebot-Extended is a robots.txt token only. It never appears as a user agent,
# so server and CDN rules cannot match it. Use robots.txt instead.Apache
# Applebot-Extended is a robots.txt token only. It never appears as a user agent,
# so server and CDN rules cannot match it. Use robots.txt instead.FAQ
Questions about Applebot-Extended
Does blocking Applebot-Extended remove my site from Siri or Spotlight?
No. Apple states that pages disallowing Applebot-Extended can still be included in search results.
Why don't I see Applebot-Extended in my logs?
Apple says Applebot-Extended does not crawl web pages; the crawling is done by Applebot.
How do I block Applebot-Extended?
Add "User-agent: Applebot-Extended" followed by "Disallow: /" to robots.txt.
Last reviewed Oct 6, 2026