AI crawler index

What is Amazonbot?

Amazonbot is Amazon's crawler for AI training. Improves Amazon's products and services; Amazon says it may be used to train Amazon AI models.

At a glance

Operator	Amazon
Purpose	AI training
User agent	`Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1) Chrome/W.X.Y.Z Safari/537.36`
Obeys robots.txt	Yes, according to the operator
Published IP ranges	https://developer.amazon.com/amazonbot/ip-addresses/
How to verify it	Amazon publishes its IP addresses; match the source IP against them.
Official documentation	https://developer.amazon.com/amazonbot

Should you block Amazonbot?

It collects pages for model training, not for answering questions in real time. Blocking it keeps your future content out of that operator's training data, but it does not take you out of AI search answers, which other crawlers feed. Block it if you do not want your content in training sets; allow it if you want future models to know your brand.

It ignores Crawl-delay and caches robots.txt for up to 30 days. Alexa's search uses a separate crawler, Amzn-SearchBot.

How to block or allow Amazonbot in robots.txt

Block it everywhere:

User-agent: Amazonbot
Disallow: /

Allow it everywhere:

User-agent: Amazonbot
Allow: /

Rules are matched by the token on the User-agent line. Test the result with the robots.txt tester before you publish it.

How to verify that a visit is really Amazonbot

Anyone can write Amazonbot in a user agent, so the user agent alone proves nothing. Take the IP address of the request from your server logs and check it.

Amazon lists the IP addresses it crawls from on its own page: the IP of the request must be on it.

Other Amazon crawlers

Amzn-SearchBot: Search engine

Check your own site

The AI crawler checker tells you which AI crawlers your robots.txt lets in, and the log file analyzer shows how often each one actually visits. For the bigger picture, see what AI crawlers are and the full AI crawler index.

What our data says about Amazonbot

Figures we measured on real AI answers and websites. Each one links to its study, with the method, the sample and the date.

12.6%

12.6% of the websites AI cites most in Spain block Amazonbot from crawling their site, and 11.5% name it in a robots.txt group of its own.

Sample: 382 websites AI cites for three or more of 43 brands in Spain. Source: Mencoro (October 2026), in Which AI crawlers do the websites AI cites let in?