Log in
Sign up with Google

Search engine crawler · RightDao

Centurybot is RightDao’s search engine crawler

Centurybot is the web crawler of RightDao, a search engine. It indexes pages for RightDao's search results.

Respects robots.txt

Our take

Allow

It is a search engine crawler that respects robots.txt and can bring visibility.

User agent

Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Centurybot/1.0; +http://www.rightdao.com/bot.html) Chrome/131.0.0.0 Safari/537.36

01 · Operator

Who operates Centurybot

Company
RightDao
Official docs
rightdao.com

02 · Behavior

What Centurybot does

It crawls web pages to build RightDao's search index. The operator says it crawls politely, usually one page every few seconds per site. It follows robots.txt like Googlebot.

03 · Impact

Why Centurybot matters for your site

If you allow it

  • Lets your pages appear in RightDao search
  • Polite crawl rate and robots.txt support

If you block it

  • Small search engine with little referral traffic
  • Adds crawl load

04 · Allow

How to allow Centurybot

robots.txt

User-agent: Centurybot
Allow: /

Cloudflare

# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "Centurybot")
Action:     Skip › All Super Bot Fight Mode rules

# Also check Security › Bots: "Block AI bots" can block it regardless of robots.txt.

WordPress

# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: Centurybot
Allow: /

nginx

# nginx serves every user agent by default.
# Make sure no rule like this blocks it:
# if ($http_user_agent ~* "Centurybot") { return 403; }

Apache

# Apache serves every user agent by default.
# Make sure .htaccess has no rule like this:
# RewriteCond %{HTTP_USER_AGENT} Centurybot [NC]
# RewriteRule .* - [F,L]

05 · Block

How to block Centurybot

Centurybot follows robots.txt, so one rule is enough. Use a server or CDN rule only to stop spoofed copies.

robots.txt

User-agent: Centurybot
Disallow: /

Cloudflare

# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "Centurybot")
Action:     Block

WordPress

# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: Centurybot
Disallow: /

nginx

# In your server { } block:
if ($http_user_agent ~* "Centurybot") {
    return 403;
}

Apache

# .htaccess
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} Centurybot [NC]
RewriteRule .* - [F,L]
</IfModule>

06 · User agents

User agents we see for Centurybot

The user agent published by the operator:

Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Centurybot/1.0; +http://www.rightdao.com/bot.html) Chrome/131.0.0.0 Safari/537.36

07 · Verification

Is it really Centurybot?

Centurybot’s operator publishes no IP ranges or hostnames, so requests cannot be verified. Treat the user agent as a claim, and watch your logs for unusual request rates.

FAQ

Questions about Centurybot

What is Centurybot?

Centurybot is the crawler of the RightDao search engine. It indexes web pages for search.

Does Centurybot respect robots.txt?

Yes. RightDao says Centurybot follows robots.txt the same way Googlebot does.

How do I block Centurybot?

Add 'User-agent: Centurybot' with 'Disallow: /' to robots.txt, or email centurybot9@gmail.com.

Last reviewed Oct 7, 2026

Your site

See which pages Centurybot crawls on your website

Log Hero reads your server logs and shows every AI bot, every page, every day.

Sign up with Google

Free during early access