01 · Operator
Who operates Omgilibot
02 · Behavior
What Omgilibot does
Omgilibot indexes news sites, blogs, reviews, ecommerce sites and forums. The content is sold through the Webz.io API to media monitoring firms, researchers and developers. Webz.io later introduced two newer bots, Webzio and Webzio-extended. Webzio-extended tags data as usable or not for AI training.
03 · Impact
Why Omgilibot matters for your site
If you allow it
- Content may surface in media monitoring tools
- Webz.io says it complies with robots.txt
If you block it
- Your content is resold as commercial data
- Data may be used for AI training
04 · Allow
How to allow Omgilibot
robots.txt
User-agent: omgili
Allow: /Cloudflare
# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "omgili")
Action: Skip › All Super Bot Fight Mode rules
# Also check Security › Bots: "Block AI bots" can block it regardless of robots.txt.WordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: omgili
Allow: /nginx
# nginx serves every user agent by default.
# Make sure no rule like this blocks it:
# if ($http_user_agent ~* "omgili") { return 403; }Apache
# Apache serves every user agent by default.
# Make sure .htaccess has no rule like this:
# RewriteCond %{HTTP_USER_AGENT} omgili [NC]
# RewriteRule .* - [F,L]05 · Block
How to block Omgilibot
Omgilibot follows robots.txt, so one rule is enough. Use a server or CDN rule only to stop spoofed copies.
robots.txt
User-agent: omgili
Disallow: /Cloudflare
# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "omgili")
Action: BlockWordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: omgili
Disallow: /nginx
# In your server { } block:
if ($http_user_agent ~* "omgili") {
return 403;
}Apache
# .htaccess
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} omgili [NC]
RewriteRule .* - [F,L]
</IfModule>06 · User agents
User agents we see for Omgilibot
The user agent published by the operator:
omgili/0.5 +http://omgili.com07 · Verification
Is it really Omgilibot?
Omgilibot’s operator publishes no IP ranges or hostnames, so requests cannot be verified. Treat the user agent as a claim, and watch your logs for unusual request rates.
FAQ
Questions about Omgilibot
What is Omgilibot?
It is a Webz.io crawler that collects web content for the Webz.io data API.
Is Omgilibot still active?
Webz.io announced the Webzio and Webzio-extended bots as its newer crawlers. It did not state whether Omgilibot was retired.
How do I block Omgilibot?
Disallow the omgili token in robots.txt or contact Webz.io. Webz.io says it complies with such requests.
Last reviewed Oct 8, 2026