01 · Operator
Who operates ICDST BOT
- Official docs
- icdst.org
02 · Behavior
What ICDST BOT does
ICDST runs an anonymous search engine with a focus on science and journal search. The bot's user agent points to that search page. It likely fetches pages for this search index.
03 · Impact
Why ICDST BOT matters for your site
If you allow it
- Can include your pages in a science-focused search engine
- Identifies itself with an info URL
If you block it
- Small search engine with little referral traffic
- Crawling behavior not documented
04 · Allow
How to allow ICDST BOT
robots.txt
User-agent: ICDST
Allow: /Cloudflare
# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "ICDST")
Action: Skip › All Super Bot Fight Mode rules
# Also check Security › Bots: "Block AI bots" can block it regardless of robots.txt.WordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: ICDST
Allow: /nginx
# nginx serves every user agent by default.
# Make sure no rule like this blocks it:
# if ($http_user_agent ~* "ICDST") { return 403; }Apache
# Apache serves every user agent by default.
# Make sure .htaccess has no rule like this:
# RewriteCond %{HTTP_USER_AGENT} ICDST [NC]
# RewriteRule .* - [F,L]05 · Block
How to block ICDST BOT
Start with robots.txt. If ICDST BOT keeps showing up in your logs, block it at your CDN or web server.
robots.txt
User-agent: ICDST
Disallow: /Cloudflare
# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "ICDST")
Action: BlockWordPress
# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: ICDST
Disallow: /nginx
# In your server { } block:
if ($http_user_agent ~* "ICDST") {
return 403;
}Apache
# .htaccess
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} ICDST [NC]
RewriteRule .* - [F,L]
</IfModule>06 · User agents
User agents we see for ICDST BOT
| User agent | Share | Last seen | Status |
|---|---|---|---|
ICDST BOT v1.0 (+https://icdst.org/mysearch/) |
100% | Verified |
07 · Verification
Is it really ICDST BOT?
ICDST BOT’s operator publishes no IP ranges or hostnames, so requests cannot be verified. Treat the user agent as a claim, and watch your logs for unusual request rates.
IP addresses we saw from verified ICDST BOT requests
| IP range | Share | Last seen |
|---|---|---|
78.159.107.241 |
100% |
Always check against the operator’s current list; ranges change.
FAQ
Questions about ICDST BOT
What is ICDST BOT?
It is the crawler of ICDST, which runs a privacy-focused search engine for science content.
How do I block ICDST BOT?
Add a robots.txt group for the ICDST token. Its robots.txt support is not documented, so check your logs.
Last reviewed Oct 8, 2026