Sidetrade Indexer Bot: What It Is & How to Block It

01 · Operator

Who operates Sidetrade indexer bot

Company: Sidetrade
Type: AI training crawler
Official docs: datadome.co

02 · Behavior

What Sidetrade indexer bot does

The bot gathers publicly available information such as company details and market data. Sidetrade uses this data for credit risk assessment, market analysis and business profiles. The ai.robots.txt project lists it as a crawler that also collects data for AI training.

03 · Impact

Why Sidetrade indexer bot matters for your site

If you allow it

You want your company profile to be accurate in Sidetrade data
Your customers or suppliers use Sidetrade

If you block it

No traffic or visibility comes back to your site
Your content may be used for AI training
It adds crawl load

04 · Allow

How to allow Sidetrade indexer bot

robots.txt

User-agent: Sidetrade indexer bot
Allow: /

Cloudflare

# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "Sidetrade indexer bot")
Action:     Skip › All Super Bot Fight Mode rules

# Also check Security › Bots: "Block AI bots" can block it regardless of robots.txt.

WordPress

# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: Sidetrade indexer bot
Allow: /

nginx

# nginx serves every user agent by default.
# Make sure no rule like this blocks it:
# if ($http_user_agent ~* "Sidetrade indexer bot") { return 403; }

Apache

# Apache serves every user agent by default.
# Make sure .htaccess has no rule like this:
# RewriteCond %{HTTP_USER_AGENT} Sidetrade indexer bot [NC]
# RewriteRule .* - [F,L]

05 · Block

How to block Sidetrade indexer bot

Start with robots.txt. If Sidetrade indexer bot keeps showing up in your logs, block it at your CDN or web server.

robots.txt

User-agent: Sidetrade indexer bot
Disallow: /

Cloudflare

# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "Sidetrade indexer bot")
Action:     Block

WordPress

# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: Sidetrade indexer bot
Disallow: /

nginx

# In your server { } block:
if ($http_user_agent ~* "Sidetrade indexer bot") {
    return 403;
}

Apache

# .htaccess
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} Sidetrade indexer bot [NC]
RewriteRule .* - [F,L]
</IfModule>

06 · User agents

User agents we see for Sidetrade indexer bot

The user agent published by the operator:

Sidetrade indexer bot

07 · Verification

Is it really Sidetrade indexer bot?

Sidetrade indexer bot’s operator publishes no IP ranges or hostnames, so requests cannot be verified. Treat the user agent as a claim, and watch your logs for unusual request rates.

FAQ

Questions about Sidetrade indexer bot

Who operates the Sidetrade indexer bot?

It is operated by Sidetrade, a provider of AI software for order-to-cash and accounts receivable processes.

What data does the Sidetrade bot collect?

It collects public business information, such as company details and market data. Sidetrade uses it for financial analytics and AI products.

How do I block the Sidetrade indexer bot?

Add a robots.txt group for its user agent with Disallow: /. Sidetrade has not published official documentation on its robots.txt handling.

Sidetrade indexer bot is Sidetrade’s AI training crawler