01 · Operator
Who operates BitSightBot
- Company
- BitSight Technologies, Inc.
- Type
- Monitoring bot
- Official docs
- bitsight.com
02 · Behavior
What BitSightBot does
BitSight sells cybersecurity ratings and risk data about organizations. Its bot collects information from public websites for that purpose. BitSight has not published crawler documentation or IP ranges. Newer versions send a Chrome-based user agent with BitSightBot/1.0 appended.
03 · Impact
Why BitSightBot matters for your site
If you allow it
- May feed security ratings that partners or insurers see about your company
- Low request volume
If you block it
- No traffic or search benefit
- No public documentation of its behavior
- Cannot be verified by IP or DNS
04 · Allow
How to allow BitSightBot
robots.txt
User-agent: BitSightBot
Allow: /
Cloudflare
# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "BitSightBot")
Action: Skip › All Super Bot Fight Mode rules
# Also check Security › Bots: "Block AI bots" can block it regardless of robots.txt.
WordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: BitSightBot
Allow: /
nginx
# nginx serves every user agent by default.
# Make sure no rule like this blocks it:
# if ($http_user_agent ~* "BitSightBot") { return 403; }
Apache
# Apache serves every user agent by default.
# Make sure .htaccess has no rule like this:
# RewriteCond %{HTTP_USER_AGENT} BitSightBot [NC]
# RewriteRule .* - [F,L]
05 · Block
How to block BitSightBot
Start with robots.txt. If BitSightBot keeps showing up in your logs, block it at your CDN or web server.
robots.txt
User-agent: BitSightBot
Disallow: /
Cloudflare
# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "BitSightBot")
Action: Block
WordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: BitSightBot
Disallow: /
nginx
# In your server { } block:
if ($http_user_agent ~* "BitSightBot") {
return 403;
}
Apache
# .htaccess
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} BitSightBot [NC]
RewriteRule .* - [F,L]
</IfModule>
06 · User agents
User agents we see for BitSightBot
The user agent published by the operator:
Mozilla/5.0 (compatible; BitSightBot/1.0)
07 · Verification
Is it really BitSightBot?
BitSightBot’s operator publishes no IP ranges or hostnames, so requests cannot be verified. Treat the user agent as a claim, and watch your logs for unusual request rates.
FAQ
Questions about BitSightBot
What is BitSightBot?
BitSightBot is a crawler from BitSight Technologies. UA databases classify it as a security checker.
Is BitSightBot an attack?
No, it is a commercial scanner from a known company. Requests with this name from unknown networks may still be spoofed.
How do I block BitSightBot?
Add 'User-agent: BitSightBot' and 'Disallow: /' to robots.txt. BitSight does not document whether it obeys robots.txt.
Last reviewed Oct 7, 2026