01 · Operator
Who operates TweetmemeBot
- Company
- DataSift
- Type
- Other bot
- Official docs
- datasift.com
02 · Behavior
What TweetmemeBot does
DataSift says the bot expands links mentioned in content from its data sources. It resolves shortened URLs and retrieves page metadata. It visits each URL at most once a day and does not follow links on the page.
03 · Impact
Why TweetmemeBot matters for your site
If you allow it
- Fetches only shared links, not whole sites
- Visits each URL at most once a day
If you block it
- No direct traffic benefit to site owners
- Feeds a commercial data service
04 · Allow
How to allow TweetmemeBot
robots.txt
User-agent: TweetmemeBot
Allow: /Cloudflare
# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "TweetmemeBot")
Action: Skip › All Super Bot Fight Mode rules
# Also check Security › Bots: "Block AI bots" can block it regardless of robots.txt.WordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: TweetmemeBot
Allow: /nginx
# nginx serves every user agent by default.
# Make sure no rule like this blocks it:
# if ($http_user_agent ~* "TweetmemeBot") { return 403; }Apache
# Apache serves every user agent by default.
# Make sure .htaccess has no rule like this:
# RewriteCond %{HTTP_USER_AGENT} TweetmemeBot [NC]
# RewriteRule .* - [F,L]05 · Block
How to block TweetmemeBot
Start with robots.txt. If TweetmemeBot keeps showing up in your logs, block it at your CDN or web server.
robots.txt
User-agent: TweetmemeBot
Disallow: /Cloudflare
# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "TweetmemeBot")
Action: BlockWordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: TweetmemeBot
Disallow: /nginx
# In your server { } block:
if ($http_user_agent ~* "TweetmemeBot") {
return 403;
}Apache
# .htaccess
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} TweetmemeBot [NC]
RewriteRule .* - [F,L]
</IfModule>06 · User agents
User agents we see for TweetmemeBot
The user agent published by the operator:
Mozilla/5.0 (compatible; TweetmemeBot/3.0; +http://tweetmeme.com/)07 · Verification
Is it really TweetmemeBot?
TweetmemeBot’s operator publishes no IP ranges or hostnames, so requests cannot be verified. Treat the user agent as a claim, and watch your logs for unusual request rates.
FAQ
Questions about TweetmemeBot
What does TweetmemeBot do?
It resolves links shared in social content, including shortened URLs, and collects page metadata. It does not crawl beyond the shared link.
How do I stop TweetmemeBot?
DataSift's bot page asks site owners to contact it to blacklist a domain. You can also block the TweetmemeBot user agent on your server.
Last reviewed Oct 8, 2026