AI crawlers · PerplexityBot
PerplexityBot: Perplexity's AI search indexer
PerplexityBot is Perplexity's AI search indexer. What it does, whether to allow it, robots.txt rules and how to verify real PerplexityBot traffic.
↓ Markdown for agents- Vendor
- Perplexity
- Type
- AI search indexer
- Runs JavaScript
- No
- IP ranges published
- Yes
PerplexityBot is Perplexity's crawler that builds the search index behind Perplexity. When someone asks a question, the answer is grounded in, and cites, pages this bot has indexed.
Should you allow PerplexityBot?
Allow it. If PerplexityBot can't crawl you, Perplexity can't cite you, no matter how good your content is. Blocking it is the most common mechanical reason a brand is missing from AI answers.
robots.txt
To allow PerplexityBot everywhere:
User-agent: PerplexityBot
Allow: /To block it:
User-agent: PerplexityBot
Disallow: /Bots follow the most specific User-agent group that matches them. If you have a User-agent: PerplexityBot group, the rules under User-agent: * no longer apply to it. Matching on the token is case-insensitive.
Identifying PerplexityBot
PerplexityBot identifies itself with PerplexityBot in its User-Agent header. It does not run JavaScript: it reads the raw HTML only. Content your site adds with JavaScript is invisible to it.
Perplexity publishes the IP ranges PerplexityBot crawls from at www.perplexity.ai/perplexitybot.json. Anyone can fake a user agent, so a hit claiming to be PerplexityBot from outside those ranges is spoofed. LLMentions' bots_report checks this for you.
Check your site
llmentions audit example.com # is PerplexityBot allowed by robots.txt, and what does it see?
llmentions bots /var/log/nginx/access.log # did PerplexityBot really visit, and is it genuine?Or identify any user agent over REST (free): GET https://api.llmentions.com/v1/bots/lookup?ua=PerplexityBot.
Other Perplexity bots
- Perplexity-User: live AI user fetch