01 · Operator
Who operates PoweredByBot
- Company
- Keywords Everywhere
- Type
- Other bot
- Official docs
- poweredby.keywordseverywhere.com
02 · Behavior
What PoweredByBot does
It scans homepages to collect technology fingerprints for the PoweredBy database. It does not deep-crawl sites. It also fetches policy files such as robots.txt and llms.txt to record crawler restrictions.
03 · Impact
Why PoweredByBot matters for your site
If you allow it
- Homepage-only scans with light load
- Strictly honors robots.txt, even for manual rescans
If you block it
- No search traffic benefit
- Your technology stack becomes public in a database
04 · Allow
How to allow PoweredByBot
robots.txt
User-agent: PoweredByBot
Allow: /Cloudflare
# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "PoweredByBot")
Action: Skip › All Super Bot Fight Mode rules
# Also check Security › Bots: "Block AI bots" can block it regardless of robots.txt.WordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: PoweredByBot
Allow: /nginx
# nginx serves every user agent by default.
# Make sure no rule like this blocks it:
# if ($http_user_agent ~* "PoweredByBot") { return 403; }Apache
# Apache serves every user agent by default.
# Make sure .htaccess has no rule like this:
# RewriteCond %{HTTP_USER_AGENT} PoweredByBot [NC]
# RewriteRule .* - [F,L]05 · Block
How to block PoweredByBot
PoweredByBot follows robots.txt, so one rule is enough. Use a server or CDN rule only to stop spoofed copies.
robots.txt
User-agent: PoweredByBot
Disallow: /Cloudflare
# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "PoweredByBot")
Action: BlockWordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: PoweredByBot
Disallow: /nginx
# In your server { } block:
if ($http_user_agent ~* "PoweredByBot") {
return 403;
}Apache
# .htaccess
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} PoweredByBot [NC]
RewriteRule .* - [F,L]
</IfModule>06 · User agents
User agents we see for PoweredByBot
| User agent | Share | Last seen | Status |
|---|---|---|---|
PoweredByBot/1.0 (+https://poweredby.keywordseverywhere.com/bot) |
100% | Unverified |
07 · Verification
Is it really PoweredByBot?
Anyone can copy a user agent. A reverse DNS lookup of a real request resolves to poweredby.keywordseverywhere.com, and that hostname resolves back to the same IP.
FAQ
Questions about PoweredByBot
What is PoweredByBot?
It is the crawler of PoweredBy by Keywords Everywhere. It detects which technologies power a website.
Does PoweredByBot respect robots.txt?
Yes. If robots.txt disallows PoweredByBot or all bots, it does not fetch the site, even on manual rescans.
How can I verify PoweredByBot?
Use forward-confirmed reverse DNS. Its documented hosts are under poweredby.keywordseverywhere.com.
Last reviewed Oct 8, 2026