Amazonbot: what it is and how to block it
Improves Amazon products and services; Amazon says the data may be used to train Amazon AI models.
Does Amazonbot follow robots.txt?
Amazon documents robots.txt control for Amazonbot.
What blocking it does
Stops Amazonbot crawling, including for AI training.
User-agent string
How it appears in your server logs (from Amazon's documentation; the version number can change):
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1) Chrome/W.X.Y.Z Safari/537.36
Anyone can send this string. Verify real visits against the operator's published IP ranges or reverse DNS before trusting it.
Other Amazon tokens
- Amzn-SearchBot: ai search index. Improves search experiences in Amazon products such as Alexa. Amazon says it does not crawl for AI training.
- Amzn-User: user-requested fetch. Fetches pages for actions a user starts. Amazon says it does not crawl for AI training.
Block Amazonbot everywhere
User-agent: Amazonbot
Disallow: /
Block only some folders
User-agent: Amazonbot
Disallow: /members/
Disallow: /drafts/
Explicitly allow it
User-agent: Amazonbot
Allow: /
A group that names Amazonbot replaces the * group for it. Copy any shared rules into this group too. Test the result.
Amazonbot questions
What is Amazonbot?
Amazonbot is operated by Amazon. Improves Amazon products and services; Amazon says the data may be used to train Amazon AI models.
How do I block Amazonbot?
Add "User-agent: Amazonbot" followed by "Disallow: /" to your robots.txt. Amazon documents robots.txt control for Amazonbot.
What happens if I block Amazonbot?
Stops Amazonbot crawling, including for AI training.
Does blocking Amazonbot block other Amazon crawlers?
No. Amazon documents Amzn-SearchBot, Amzn-User separately; each needs its own User-agent line if you want to block it.