01 · Operator
Who operates Taboolabot
- Company
- Taboola
- Type
- Other bot
- Official docs
- realize.com
02 · Behavior
What Taboolabot does
It scans advertiser landing pages and publisher pages. It extracts titles and thumbnails from meta tags such as og:title and og:image. Taboola uses this data for ad creation and placement.
03 · Impact
Why Taboolabot matters for your site
If you allow it
- Needed if you advertise or publish with Taboola
- Supplies titles and images for recommendation widgets
If you block it
- No benefit if you do not work with Taboola
- No search visibility
04 · Allow
How to allow Taboolabot
robots.txt
User-agent: Taboolabot
Allow: /Cloudflare
# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "Taboolabot")
Action: Skip › All Super Bot Fight Mode rules
# Also check Security › Bots: "Block AI bots" can block it regardless of robots.txt.WordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: Taboolabot
Allow: /nginx
# nginx serves every user agent by default.
# Make sure no rule like this blocks it:
# if ($http_user_agent ~* "Taboolabot") { return 403; }Apache
# Apache serves every user agent by default.
# Make sure .htaccess has no rule like this:
# RewriteCond %{HTTP_USER_AGENT} Taboolabot [NC]
# RewriteRule .* - [F,L]05 · Block
How to block Taboolabot
Start with robots.txt. If Taboolabot keeps showing up in your logs, block it at your CDN or web server.
robots.txt
User-agent: Taboolabot
Disallow: /Cloudflare
# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "Taboolabot")
Action: BlockWordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: Taboolabot
Disallow: /nginx
# In your server { } block:
if ($http_user_agent ~* "Taboolabot") {
return 403;
}Apache
# .htaccess
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} Taboolabot [NC]
RewriteRule .* - [F,L]
</IfModule>06 · User agents
User agents we see for Taboolabot
The user agent published by the operator:
Mozilla/5.0 (compatible; Taboolabot/3.7; +http://www.taboola.com)07 · Verification
Is it really Taboolabot?
Taboolabot’s operator publishes no IP ranges or hostnames, so requests cannot be verified. Treat the user agent as a claim, and watch your logs for unusual request rates.
FAQ
Questions about Taboolabot
What is Taboolabot?
It is Taboola's crawler. It scans landing pages and publisher pages for content and metadata.
Should I block Taboolabot?
Taboola says its crawler must be allowed for its services to work. If you do not use Taboola, blocking it has little downside.
Which meta tags does Taboolabot read?
It reads titles from og:title or the title meta tag, and thumbnails from og:image and similar image tags.
Last reviewed Oct 8, 2026