Log in
Sign up with Google

Search engine crawler · Yandex

YandexSitelinks is Yandex’s search engine crawler

YandexSitelinks is a Yandex robot that checks pages used as sitelinks in search results.

Verifiable operator Respects robots.txt

Our take

Allow

It keeps your sitelinks in Yandex results working and respects robots.txt.

User agent

Mozilla/5.0 (compatible; YandexSitelinks; Dyatel; +http://yandex.com/bots)

01 · Operator

Who operates YandexSitelinks

Company
Yandex
Official docs
yandex.com

02 · Behavior

What YandexSitelinks does

Sitelinks are extra links shown under a site in Yandex results. This robot checks that those pages are available. It follows robots.txt.

03 · Impact

Why YandexSitelinks matters for your site

If you allow it

  • Keeps your Yandex sitelinks accurate
  • Follows robots.txt

If you block it

  • Little value if you get no traffic from Yandex

04 · Allow

How to allow YandexSitelinks

robots.txt

User-agent: YandexSitelinks
Allow: /

Cloudflare

# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "YandexSitelinks")
Action:     Skip › All Super Bot Fight Mode rules

# Also check Security › Bots: "Block AI bots" can block it regardless of robots.txt.

WordPress

# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: YandexSitelinks
Allow: /

nginx

# nginx serves every user agent by default.
# Make sure no rule like this blocks it:
# if ($http_user_agent ~* "YandexSitelinks") { return 403; }

Apache

# Apache serves every user agent by default.
# Make sure .htaccess has no rule like this:
# RewriteCond %{HTTP_USER_AGENT} YandexSitelinks [NC]
# RewriteRule .* - [F,L]

05 · Block

How to block YandexSitelinks

YandexSitelinks follows robots.txt, so one rule is enough. Use a server or CDN rule only to stop spoofed copies.

robots.txt

User-agent: YandexSitelinks
Disallow: /

Cloudflare

# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "YandexSitelinks")
Action:     Block

WordPress

# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: YandexSitelinks
Disallow: /

nginx

# In your server { } block:
if ($http_user_agent ~* "YandexSitelinks") {
    return 403;
}

Apache

# .htaccess
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} YandexSitelinks [NC]
RewriteRule .* - [F,L]
</IfModule>

06 · User agents

User agents we see for YandexSitelinks

The user agent published by the operator:

Mozilla/5.0 (compatible; YandexSitelinks; Dyatel; +http://yandex.com/bots)

07 · Verification

Is it really YandexSitelinks?

Anyone can copy a user agent. A reverse DNS lookup of a real request resolves to yandex.ru</code>, <code>yandex.net</code>, <code>yandex.com, and that hostname resolves back to the same IP.

FAQ

Questions about YandexSitelinks

Does YandexSitelinks respect robots.txt?

Yes. Yandex lists YandexSitelinks among the robots that follow robots.txt rules.

How do I block YandexSitelinks?

Add "User-agent: YandexSitelinks" and "Disallow: /" to your robots.txt.

How can I verify that YandexSitelinks is really from Yandex?

Run a reverse DNS lookup on the IP. The hostname must end in yandex.ru, yandex.net or yandex.com, and a forward lookup must return the same IP.

Last reviewed Oct 8, 2026

Your site

See which pages YandexSitelinks crawls on your website

Log Hero reads your server logs and shows every AI bot, every page, every day.

Sign up with Google

Free during early access