AI crawler index
What is PetalBot?
PetalBot is Huawei's search engine crawler. Indexes desktop and mobile sites for Petal Search, Huawei Assistant and Huawei's AI search.
At a glance
| Operator | Huawei |
|---|---|
| Purpose | Search engine |
| User agent | Mozilla/5.0 (compatible;PetalBot;+https://webmaster.petalsearch.com/site/petalbot) |
| Obeys robots.txt | Yes, according to the operator |
| Published IP ranges | Not documented by the operator |
| How to verify it | Reverse DNS must be in petalsearch.com, then a forward lookup must return the same IP. |
| Official documentation | https://webmaster.petalsearch.com/site/petalbot |
Should you block PetalBot?
It is a classic search engine crawler. Blocking it removes you from that search engine and from the products built on its index, so most sites should allow it.
Blocking it makes your pages unsearchable in Petal. Removing pages it has already indexed can take several months.
How to block or allow PetalBot in robots.txt
Block it everywhere:
User-agent: PetalBot
Disallow: /Allow it everywhere:
User-agent: PetalBot
Allow: /Rules are matched by the token on the User-agent line. Test the result with the robots.txt tester before you publish it.
Check your own site
The AI crawler checker tells you which AI crawlers your robots.txt lets in, and the log file analyzer shows how often each one actually visits. For the bigger picture, see what AI crawlers are and the full AI crawler index.
FAQ
PetalBot questions
Start tracking your brand in AI search today
Monitor how AI engines cite your brand, track keyword positions, and benchmark against competitors, all in one platform.