AI crawler index
What is PerplexityBot?
PerplexityBot is Perplexity's crawler for AI search. Surfaces and links websites in Perplexity's search results. Perplexity says it is not used to train foundation models.
At a glance
| Operator | Perplexity |
|---|---|
| Purpose | AI search |
| User agent | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot) |
| Obeys robots.txt | Yes, according to the operator |
| Published IP ranges | https://www.perplexity.com/perplexitybot.json |
| How to verify it | Match both the user agent and the source IP against Perplexity's published list. |
| Official documentation | https://docs.perplexity.ai/docs/resources/perplexity-crawlers |
Should you block PerplexityBot?
It builds the index an AI search engine cites from. Blocking it can remove your pages from that engine's answers and links, so if you want to be cited there, allow it.
Blocking it removes your site from Perplexity's search results, and Perplexity recommends allowing it. Changes can take up to 24 hours.
How to block or allow PerplexityBot in robots.txt
Block it everywhere:
User-agent: PerplexityBot
Disallow: /Allow it everywhere:
User-agent: PerplexityBot
Allow: /Rules are matched by the token on the User-agent line. Test the result with the robots.txt tester before you publish it.
Other Perplexity crawlers
- Perplexity-User: User-triggered fetch
Check your own site
The AI crawler checker tells you which AI crawlers your robots.txt lets in, and the log file analyzer shows how often each one actually visits. For the bigger picture, see what AI crawlers are and the full AI crawler index.
FAQ
PerplexityBot questions
Start tracking your brand in AI search today
Monitor how AI engines cite your brand, track keyword positions, and benchmark against competitors, all in one platform.