Log in
Sign up with Google

AI training crawler · SB Intuitions Corp.

SBIntuitionsBot is SB Intuitions Corp.’s AI training crawler

SBIntuitionsBot is the crawler of SB Intuitions Corp., a Japanese AI company. It collects data for AI development and information analysis.

Respects robots.txt

Our take

Your call

It is a documented AI training crawler, so blocking depends on your content policy.

User agent

Mozilla/5.0 (compatible; SBIntuitionsBot/0.1; +https://www.sbintuitions.co.jp/bot/)

01 · Operator

Who operates SBIntuitionsBot

Official docs
sbintuitions.co.jp

02 · Behavior

What SBIntuitionsBot does

The bot fetches public web pages for AI development and information analysis. SB Intuitions states it follows the Robots Exclusion Protocol (RFC 9309). A separate crawler, SBIntuitions-SearchBot, serves its Sarashina service.

03 · Impact

Why SBIntuitionsBot matters for your site

If you allow it

  • Documented operator and purpose
  • Follows robots.txt
  • Your content may inform Japanese language models

If you block it

  • Collects content for AI training
  • No direct traffic back to your site

04 · Allow

How to allow SBIntuitionsBot

robots.txt

User-agent: SBIntuitionsBot
Allow: /

Cloudflare

# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "SBIntuitionsBot")
Action:     Skip › All Super Bot Fight Mode rules

# Also check Security › Bots: "Block AI bots" can block it regardless of robots.txt.

WordPress

# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: SBIntuitionsBot
Allow: /

nginx

# nginx serves every user agent by default.
# Make sure no rule like this blocks it:
# if ($http_user_agent ~* "SBIntuitionsBot") { return 403; }

Apache

# Apache serves every user agent by default.
# Make sure .htaccess has no rule like this:
# RewriteCond %{HTTP_USER_AGENT} SBIntuitionsBot [NC]
# RewriteRule .* - [F,L]

05 · Block

How to block SBIntuitionsBot

SBIntuitionsBot follows robots.txt, so one rule is enough. Use a server or CDN rule only to stop spoofed copies.

robots.txt

User-agent: SBIntuitionsBot
Disallow: /

Cloudflare

# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "SBIntuitionsBot")
Action:     Block

WordPress

# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: SBIntuitionsBot
Disallow: /

nginx

# In your server { } block:
if ($http_user_agent ~* "SBIntuitionsBot") {
    return 403;
}

Apache

# .htaccess
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} SBIntuitionsBot [NC]
RewriteRule .* - [F,L]
</IfModule>

06 · User agents

User agents we see for SBIntuitionsBot

The user agent published by the operator:

Mozilla/5.0 (compatible; SBIntuitionsBot/0.1; +https://www.sbintuitions.co.jp/bot/)

07 · Verification

Is it really SBIntuitionsBot?

SBIntuitionsBot’s operator publishes no IP ranges or hostnames, so requests cannot be verified. Treat the user agent as a claim, and watch your logs for unusual request rates.

FAQ

Questions about SBIntuitionsBot

What is SBIntuitionsBot?

It is the web crawler of SB Intuitions Corp. It gathers data for AI development and information analysis.

Does SBIntuitionsBot respect robots.txt?

Yes. SB Intuitions says its crawlers comply with the Robots Exclusion Protocol in RFC 9309.

How do I block SBIntuitionsBot?

Add "User-agent: SBIntuitionsBot" followed by "Disallow: /" to your robots.txt file.

Last reviewed Oct 8, 2026

Your site

See which pages SBIntuitionsBot crawls on your website

Log Hero reads your server logs and shows every AI bot, every page, every day.

Sign up with Google

Free during early access