PerplexityBot
Perplexity's web crawler, which indexes pages so they can be surfaced and linked in Perplexity's answers; Perplexity says it isn't used for model training.
PerplexityBot builds the index Perplexity searches when it answers. If it can't reach your pages, Perplexity has a much harder time citing them. Perplexity also runs a second agent, Perplexity-User, that fetches pages when a person's question calls for it.
PerplexityBot vs. Perplexity-User
- PerplexityBot crawls to surface and link sites in Perplexity's results. Perplexity recommends allowing it in robots.txt and says it isn't used to crawl content for AI foundation models.
- Perplexity-User acts on behalf of a person. Because a user requested the fetch, Perplexity says it generally ignores robots.txt.
Perplexity publishes IP ranges for both agents, which helps when you allowlist them in a firewall. It also says robots.txt changes can take up to 24 hours to take effect.
User-agent: PerplexityBot
Allow: /Why PerplexityBot matters
Perplexity is search-first and shows its sources prominently, so it rewards pages that are crawlable, specific and current. Allow it alongside OAI-SearchBot and Claude-SearchBot, and treat the training crawlers as a separate decision. See our Perplexity engine page for tactics, and run the Citeplot audit to confirm access.
Bring better evidence to your next pitch.
Start a 14-day trial. Explore clearly labelled sample data, then build the evidence for your clients. No card required.