01 · Operator
Who operates ArenaUnfurlBot
- Company
- Arena
- Type
- Social preview bot
- Official docs
- knownagents.com
02 · Behavior
What ArenaUnfurlBot does
ArenaUnfurlBot requests shared URLs to generate link previews with title, description and image. Arena is a site for chatting with, comparing and voting on AI models. It is a fetcher, not a crawler.
03 · Impact
Why ArenaUnfurlBot matters for your site
If you allow it
- Links to your site get a proper preview on Arena
- Requests are triggered by shared links, so volume is low
If you block it
- It is not expected to follow robots.txt
- No verification method is published
04 · Allow
How to allow ArenaUnfurlBot
robots.txt
# ArenaUnfurlBot has no documented robots.txt token and does not read robots.txt.
# Use a Cloudflare, nginx or Apache rule instead.
Cloudflare
# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "ArenaUnfurlBot")
Action: Skip › All Super Bot Fight Mode rules
# Also check Security › Bots: "Block AI bots" can block it regardless of robots.txt.
WordPress
# ArenaUnfurlBot has no documented robots.txt token and does not read robots.txt.
# Use a Cloudflare, nginx or Apache rule instead.
nginx
# nginx serves every user agent by default.
# Make sure no rule like this blocks it:
# if ($http_user_agent ~* "ArenaUnfurlBot") { return 403; }
Apache
# Apache serves every user agent by default.
# Make sure .htaccess has no rule like this:
# RewriteCond %{HTTP_USER_AGENT} ArenaUnfurlBot [NC]
# RewriteRule .* - [F,L]
05 · Block
How to block ArenaUnfurlBot
ArenaUnfurlBot has been reported to ignore robots.txt. Block it at your CDN or web server as well.
robots.txt
# ArenaUnfurlBot has no documented robots.txt token and does not read robots.txt.
# Use a Cloudflare, nginx or Apache rule instead.
Cloudflare
# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "ArenaUnfurlBot")
Action: Block
WordPress
# ArenaUnfurlBot has no documented robots.txt token and does not read robots.txt.
# Use a Cloudflare, nginx or Apache rule instead.
nginx
# In your server { } block:
if ($http_user_agent ~* "ArenaUnfurlBot") {
return 403;
}
Apache
# .htaccess
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} ArenaUnfurlBot [NC]
RewriteRule .* - [F,L]
</IfModule>
06 · User agents
User agents we see for ArenaUnfurlBot
The user agent published by the operator:
ArenaUnfurlBot/1.0 (Link preview bot for AI model comparison platform; +https://arena.ai) Mozilla/5.0 (compatible)
07 · Verification
Is it really ArenaUnfurlBot?
ArenaUnfurlBot’s operator publishes no IP ranges or hostnames, so requests cannot be verified. Treat the user agent as a claim, and watch your logs for unusual request rates.
FAQ
Questions about ArenaUnfurlBot
What is ArenaUnfurlBot?
It is the link preview bot of Arena, an AI model comparison platform. It fetches pages to build previews of shared links.
Does ArenaUnfurlBot respect robots.txt?
Known Agents states it is not expected to follow robots.txt, as is typical for link preview fetchers.
How can I verify ArenaUnfurlBot?
No IP list or reverse DNS method is published. Matching relies on the user agent string.
Last updated Oct 19, 2026