Free public diagnostic

Perplexity Crawler Checker

Use the Perplexity Crawler Checker to inspect PerplexityBot robots.txt policy and understand user-requested retrieval limits.

Free scan · No signup required · Up to 5 public pages
Your URL stays out of analytics. Results stay in this tab. Privacy details

Read policy, evidence and uncertainty together

A successful fetch from AI Crawl Score means our generic client received a response. It does not establish how a verified crawler will be treated by your server or CDN. The crawler matrix interprets the page’s robots rules; it does not claim to observe real crawler visits.

Use the result to prioritize a review

Check failed findings first, then examine unknown or untested signals. Open each finding for its weight, evidence and recommended action. Keep deliberate exclusions intact on pages that should remain private or undiscoverable.

Explore documented crawlers · Review our sources

Frequently asked questions

Does Perplexity-User follow the same rules as PerplexityBot?

They serve different purposes. PerplexityBot supports search discovery; Perplexity-User is user-requested retrieval and generally ignores robots.txt rules. Consult the linked operator sources.

Official references for this check

Source records reviewed . Operator documentation defines crawler behavior; the report describes our observations.

Continue your review

AI Crawler Checker · All free tools