Frequently asked questions
Does my website need an llms.txt file?
No. It is an optional documentation convention. This checker reports availability and a title heading; a missing file does not reduce AI Crawl Score.
Use the free llms.txt Checker to inspect file availability and a Markdown title heading, with clear limits on what the result proves.
A successful fetch from AI Crawl Score means our generic client received a response. It does not establish how a verified crawler will be treated by your server or CDN. The crawler matrix interprets the page’s robots rules; it does not claim to observe real crawler visits.
Check failed findings first, then examine unknown or untested signals. Open each finding for its weight, evidence and recommended action. Keep deliberate exclusions intact on pages that should remain private or undiscoverable.
No. It is an optional documentation convention. This checker reports availability and a title heading; a missing file does not reduce AI Crawl Score.
Source records reviewed . Operator documentation defines crawler behavior; the report describes our observations.