Log in
Sign up with Google

SEO tool crawler · Sitebulb Limited

Sitebulb is Sitebulb Limited’s SEO tool crawler

Sitebulb is a website crawler for technical SEO audits, made by Sitebulb Limited in the UK. Its users start crawls of the sites they audit.

Renders JavaScript

Our take

Your call

It is a user-run SEO audit tool that helps only if you or your partners use it.

robots.txt token

User-agent: Sitebulb

01 · Operator

Who operates Sitebulb

Official docs
sitebulb.com

02 · Behavior

What Sitebulb does

Sitebulb is sold as desktop software and as a cloud service. Users run audits that check pages for hundreds of technical SEO issues. It can render JavaScript during crawls. Traffic comes from the user's machine or Sitebulb's cloud, not from one central bot.

03 · Impact

Why Sitebulb matters for your site

If you allow it

  • You or your SEO agency use Sitebulb to audit your site
  • Audits can find technical problems

If you block it

  • Unknown third parties may audit your site
  • Large crawls add server load

04 · Allow

How to allow Sitebulb

robots.txt

User-agent: Sitebulb
Allow: /

Cloudflare

# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "Sitebulb")
Action:     Skip › All Super Bot Fight Mode rules

# Also check Security › Bots: "Block AI bots" can block it regardless of robots.txt.

WordPress

# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: Sitebulb
Allow: /

nginx

# nginx serves every user agent by default.
# Make sure no rule like this blocks it:
# if ($http_user_agent ~* "Sitebulb") { return 403; }

Apache

# Apache serves every user agent by default.
# Make sure .htaccess has no rule like this:
# RewriteCond %{HTTP_USER_AGENT} Sitebulb [NC]
# RewriteRule .* - [F,L]

05 · Block

How to block Sitebulb

Start with robots.txt. If Sitebulb keeps showing up in your logs, block it at your CDN or web server.

robots.txt

User-agent: Sitebulb
Disallow: /

Cloudflare

# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "Sitebulb")
Action:     Block

WordPress

# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: Sitebulb
Disallow: /

nginx

# In your server { } block:
if ($http_user_agent ~* "Sitebulb") {
    return 403;
}

Apache

# .htaccess
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} Sitebulb [NC]
RewriteRule .* - [F,L]
</IfModule>

06 · User agents

User agents we see for Sitebulb

The operator does not publish a full user agent string. Requests contain the token “Sitebulb”.

07 · Verification

Is it really Sitebulb?

Sitebulb’s operator publishes no IP ranges or hostnames, so requests cannot be verified. Treat the user agent as a claim, and watch your logs for unusual request rates.

FAQ

Questions about Sitebulb

What is Sitebulb?

Sitebulb is a website crawler for SEO audits from Sitebulb Limited. It is available as desktop software and as a cloud version.

Can Sitebulb render JavaScript?

Yes. Sitebulb offers JavaScript crawling, so it can audit sites that rely on client-side rendering.

Why is Sitebulb crawling my site?

Someone using Sitebulb has started an audit of your site. This may be your own team, an agency or a competitor.

Last reviewed Oct 8, 2026

Your site

See which pages Sitebulb crawls on your website

Log Hero reads your server logs and shows every AI bot, every page, every day.

Sign up with Google

Free during early access