01 · Operator
Who operates WebwikiBot
- Company
- webwiki GmbH
- Type
- Other bot
- Official docs
- webwiki.com
02 · Behavior
What WebwikiBot does
Webwiki lists websites with descriptions and user reviews in several country versions. WebwikiBot visits listed sites, likely to collect metadata for these listings. Webwiki has not published a dedicated bot page.
03 · Impact
Why WebwikiBot matters for your site
If you allow it
- Keeps your Webwiki listing current
- Webwiki listings can send some referral traffic
If you block it
- No dedicated documentation
- Limited value if you do not use Webwiki
04 · Allow
How to allow WebwikiBot
robots.txt
User-agent: WebwikiBot
Allow: /Cloudflare
# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "WebwikiBot")
Action: Skip › All Super Bot Fight Mode rules
# Also check Security › Bots: "Block AI bots" can block it regardless of robots.txt.WordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: WebwikiBot
Allow: /nginx
# nginx serves every user agent by default.
# Make sure no rule like this blocks it:
# if ($http_user_agent ~* "WebwikiBot") { return 403; }Apache
# Apache serves every user agent by default.
# Make sure .htaccess has no rule like this:
# RewriteCond %{HTTP_USER_AGENT} WebwikiBot [NC]
# RewriteRule .* - [F,L]05 · Block
How to block WebwikiBot
Start with robots.txt. If WebwikiBot keeps showing up in your logs, block it at your CDN or web server.
robots.txt
User-agent: WebwikiBot
Disallow: /Cloudflare
# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "WebwikiBot")
Action: BlockWordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: WebwikiBot
Disallow: /nginx
# In your server { } block:
if ($http_user_agent ~* "WebwikiBot") {
return 403;
}Apache
# .htaccess
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} WebwikiBot [NC]
RewriteRule .* - [F,L]
</IfModule>06 · User agents
User agents we see for WebwikiBot
The user agent published by the operator:
Mozilla/5.0 (compatible; WebwikiBot/2.1; +https://www.webwiki.com)07 · Verification
Is it really WebwikiBot?
WebwikiBot’s operator publishes no IP ranges or hostnames, so requests cannot be verified. Treat the user agent as a claim, and watch your logs for unusual request rates.
FAQ
Questions about WebwikiBot
What is WebwikiBot?
It is the crawler of Webwiki, a website directory and review site operated by webwiki GmbH.
How do I block WebwikiBot?
Add "User-agent: WebwikiBot" and "Disallow: /" to robots.txt, or block the user agent on your server.
Last reviewed Oct 8, 2026