Log in
Sign up with Google

AI assistant fetcher · Amazon Web Services

amazon-QBusiness is Amazon Web Services’ AI assistant fetcher

amazon-QBusiness is the web crawler of Amazon Q Business, an enterprise AI assistant from AWS. It indexes websites that Amazon Q Business customers add as a data source.

Respects robots.txt

Our take

Allow

It is a customer-configured AI assistant crawler that respects robots.txt and is often crawling sites its operator controls.

User agent

amazon-QBusiness

01 · Operator

Who operates amazon-QBusiness

Official docs
docs.aws.amazon.com

02 · Behavior

What amazon-QBusiness does

An Amazon Q Business customer configures the Web Crawler connector with a set of URLs. The crawler fetches those pages and indexes them for search and answers inside that customer's assistant. It follows Allow and Disallow rules in robots.txt.

03 · Impact

Why amazon-QBusiness matters for your site

If you allow it

  • Lets a company's internal AI assistant answer questions with your content
  • Respects robots.txt

If you block it

  • Content is used inside private enterprise assistants
  • No public referral traffic

04 · Allow

How to allow amazon-QBusiness

robots.txt

User-agent: amazon-QBusiness
Allow: /

Cloudflare

# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "amazon-QBusiness")
Action:     Skip › All Super Bot Fight Mode rules

# Also check Security › Bots: "Block AI bots" can block it regardless of robots.txt.

WordPress

# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: amazon-QBusiness
Allow: /

nginx

# nginx serves every user agent by default.
# Make sure no rule like this blocks it:
# if ($http_user_agent ~* "amazon\-QBusiness") { return 403; }

Apache

# Apache serves every user agent by default.
# Make sure .htaccess has no rule like this:
# RewriteCond %{HTTP_USER_AGENT} amazon\-QBusiness [NC]
# RewriteRule .* - [F,L]

05 · Block

How to block amazon-QBusiness

amazon-QBusiness follows robots.txt, so one rule is enough. Use a server or CDN rule only to stop spoofed copies.

robots.txt

User-agent: amazon-QBusiness
Disallow: /

Cloudflare

# Security › WAF › Custom rules › Create rule
Expression: (http.user_agent contains "amazon-QBusiness")
Action:     Block

WordPress

# WordPress serves a virtual robots.txt. Edit it with your SEO plugin:
# Yoast: SEO › Tools › File editor · Rank Math: General Settings › Edit robots.txt
User-agent: amazon-QBusiness
Disallow: /

nginx

# In your server { } block:
if ($http_user_agent ~* "amazon\-QBusiness") {
    return 403;
}

Apache

# .htaccess
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} amazon\-QBusiness [NC]
RewriteRule .* - [F,L]
</IfModule>

06 · User agents

User agents we see for amazon-QBusiness

The user agent published by the operator:

amazon-QBusiness

07 · Verification

Is it really amazon-QBusiness?

amazon-QBusiness’s operator publishes no IP ranges or hostnames, so requests cannot be verified. Treat the user agent as a claim, and watch your logs for unusual request rates.

FAQ

Questions about amazon-QBusiness

What is the amazon-QBusiness user agent?

It is the Amazon Q Business Web Crawler. It indexes web pages that a customer adds as a data source for their Amazon Q Business assistant.

Does amazon-QBusiness respect robots.txt?

Yes. AWS states that the crawler follows standard Allow and Disallow directives in robots.txt.

How do I block amazon-QBusiness?

Add 'User-agent: amazon-QBusiness' followed by 'Disallow: /' to your robots.txt file.

Last reviewed Oct 7, 2026

Your site

See which pages amazon-QBusiness crawls on your website

Log Hero reads your server logs and shows every AI bot, every page, every day.

Sign up with Google

Free during early access