01 · Operator
Who operates Brightbot
- Company
- Bright Data
- Type
- Other bot
- Official docs
- brightdata.com
02 · Behavior
What Brightbot does
Brightbot fetches public web pages for Bright Data's data products. It uses its own user agent and a dedicated source IP subnet. Bright Data says a built-in cache avoids downloading the same data more than once in 24 hours.
03 · Impact
Why Brightbot matters for your site
If you allow it
- Identifies itself openly
- Uses a published IP subnet
- Caches pages to limit repeat requests
If you block it
- Collects data for resale and third-party use
- No direct traffic benefit
- robots.txt support is not documented
04 · Allow
How to allow Brightbot
robots.txt
User-agent: Brightbot
Allow: /
Cloudflare
# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "Brightbot")
Action: Skip › All Super Bot Fight Mode rules
# Also check Security › Bots: "Block AI bots" can block it regardless of robots.txt.
WordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: Brightbot
Allow: /
nginx
# nginx serves every user agent by default.
# Make sure no rule like this blocks it:
# if ($http_user_agent ~* "Brightbot") { return 403; }
Apache
# Apache serves every user agent by default.
# Make sure .htaccess has no rule like this:
# RewriteCond %{HTTP_USER_AGENT} Brightbot [NC]
# RewriteRule .* - [F,L]
05 · Block
How to block Brightbot
Start with robots.txt. If Brightbot keeps showing up in your logs, block it at your CDN or web server.
robots.txt
User-agent: Brightbot
Disallow: /
Cloudflare
# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "Brightbot")
Action: Block
WordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: Brightbot
Disallow: /
nginx
# In your server { } block:
if ($http_user_agent ~* "Brightbot") {
return 403;
}
Apache
# .htaccess
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} Brightbot [NC]
RewriteRule .* - [F,L]
</IfModule>
06 · User agents
User agents we see for Brightbot
The user agent published by the operator:
Brightbot 1.0
07 · Verification
Is it really Brightbot?
Anyone can copy a user agent. Real Brightbot requests come from the IP ranges published at brightdata.com/brightbot.
FAQ
Questions about Brightbot
How do I verify Brightbot?
Bright Data states that Brightbot uses the source subnet 82.97.199.0/24. Requests from other IPs are not genuine Brightbot traffic.
Who operates Brightbot?
Bright Data operates Brightbot as the main data collection pipeline for its products and services.
Last reviewed Oct 7, 2026