Frequently asked questions
What is the difference between OAI-SearchBot and GPTBot?
OAI-SearchBot relates to search discovery; GPTBot relates to potential training collection. The report keeps their policies separate.
Free public diagnostic
OAI-SearchBot Checker
Use the OAI-SearchBot Checker to find the matched robots.txt rule for OpenAI search discovery on a public URL.
Read policy, evidence and uncertainty together
A successful fetch from AI Crawl Score means our generic client received a response. It does not establish how a verified crawler will be treated by your server or CDN. The crawler matrix interprets the page’s robots rules; it does not claim to observe real crawler visits.
Use the result to prioritize a review
Check failed findings first, then examine unknown or untested signals. Open each finding for its weight, evidence and recommended action. Keep deliberate exclusions intact on pages that should remain private or undiscoverable.
Official references for this check
Source records reviewed . Operator documentation defines crawler behavior; the report describes our observations.