Log in
Sign up with Google

Other bot · Bright Data

Brightbot is Bright Data’s other bot

Brightbot is the data collection crawler of Bright Data, a web data company. It is the main collection pipeline for Bright Data's products and services.

Verifiable operator

Our take

Your call

Brightbot feeds a commercial data business, so the value depends on whether you want your content in such datasets.

User agent

Brightbot 1.0

01 · Operator

Who operates Brightbot

Company
Bright Data
Type
Other bot
Official docs
brightdata.com

02 · Behavior

What Brightbot does

Brightbot fetches public web pages for Bright Data's data products. It uses its own user agent and a dedicated source IP subnet. Bright Data says a built-in cache avoids downloading the same data more than once in 24 hours.

03 · Impact

Why Brightbot matters for your site

If you allow it

  • Identifies itself openly
  • Uses a published IP subnet
  • Caches pages to limit repeat requests

If you block it

  • Collects data for resale and third-party use
  • No direct traffic benefit
  • robots.txt support is not documented

04 · Allow

How to allow Brightbot

robots.txt

User-agent: Brightbot
Allow: /

Cloudflare

# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "Brightbot")
Action:     Skip › All Super Bot Fight Mode rules

# Also check Security › Bots: "Block AI bots" can block it regardless of robots.txt.

WordPress

# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: Brightbot
Allow: /

nginx

# nginx serves every user agent by default.
# Make sure no rule like this blocks it:
# if ($http_user_agent ~* "Brightbot") { return 403; }

Apache

# Apache serves every user agent by default.
# Make sure .htaccess has no rule like this:
# RewriteCond %{HTTP_USER_AGENT} Brightbot [NC]
# RewriteRule .* - [F,L]

05 · Block

How to block Brightbot

Start with robots.txt. If Brightbot keeps showing up in your logs, block it at your CDN or web server.

robots.txt

User-agent: Brightbot
Disallow: /

Cloudflare

# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "Brightbot")
Action:     Block

WordPress

# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: Brightbot
Disallow: /

nginx

# In your server { } block:
if ($http_user_agent ~* "Brightbot") {
    return 403;
}

Apache

# .htaccess
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} Brightbot [NC]
RewriteRule .* - [F,L]
</IfModule>

06 · User agents

User agents we see for Brightbot

The user agent published by the operator:

Brightbot 1.0

07 · Verification

Is it really Brightbot?

Anyone can copy a user agent. Real Brightbot requests come from the IP ranges published at brightdata.com/brightbot.

FAQ

Questions about Brightbot

How do I verify Brightbot?

Bright Data states that Brightbot uses the source subnet 82.97.199.0/24. Requests from other IPs are not genuine Brightbot traffic.

Who operates Brightbot?

Bright Data operates Brightbot as the main data collection pipeline for its products and services.

Last reviewed Oct 7, 2026

Your site

See which pages Brightbot crawls on your website

Log Hero reads your server logs and shows every AI bot, every page, every day.

Sign up with Google

Free during early access