Amzn-User: what it is and how to block it
Fetches pages for actions a user starts. Amazon says it does not crawl for AI training.
Does Amzn-User follow robots.txt?
Amazon says it may not follow all robots.txt directives because actions can be user-initiated.
What blocking it does
A signal only for user-initiated fetches.
Because Amazon describes Amzn-User as fetching pages on a user's behalf, treat a robots.txt rule as a request rather than a guarantee. For a hard block, filter the user agent or Amazon's published IP ranges at your server or CDN.
Other Amazon tokens
- Amazonbot: model training. Improves Amazon products and services; Amazon says the data may be used to train Amazon AI models.
- Amzn-SearchBot: ai search index. Improves search experiences in Amazon products such as Alexa. Amazon says it does not crawl for AI training.
Block Amzn-User everywhere
User-agent: Amzn-User
Disallow: /
Block only some folders
User-agent: Amzn-User
Disallow: /members/
Disallow: /drafts/
Explicitly allow it
User-agent: Amzn-User
Allow: /
A group that names Amzn-User replaces the * group for it. Copy any shared rules into this group too. Test the result.
Amzn-User questions
What is Amzn-User?
Amzn-User is operated by Amazon. Fetches pages for actions a user starts. Amazon says it does not crawl for AI training.
How do I block Amzn-User?
Add "User-agent: Amzn-User" followed by "Disallow: /" to your robots.txt. Amazon says it may not follow all robots.txt directives because actions can be user-initiated.
What happens if I block Amzn-User?
A signal only for user-initiated fetches.
Does blocking Amzn-User block other Amazon crawlers?
No. Amazon documents Amazonbot, Amzn-SearchBot separately; each needs its own User-agent line if you want to block it.