AI Access Checker
Compare robots.txt with a live fetch for 12 AI crawlers, then read llms.txt and same-origin agent paths. One site you submit. This does not scan the internet.
Best for site owners and agencies who publish crawler rules and want to know whether the server follows them.
What This Tool Checks
- 12 crawler policy rows
- llms.txt private URLs
- Agent paths that list tools
Why It Matters
A robots.txt block is only a request. The server can still hand the homepage to a training crawler, and llms.txt can name an admin URL the rest of the site never links.
Best For
Best for site owners and agencies who publish crawler rules and want to know whether the server follows them.
What To Do Next
Use the free result once. Start AI Access Watch at $9 per month or $90 per year when you want a daily rerun and mail only when a new mismatch, private URL, or open agent path appears.
What does the AI Access Checker compare?
For 12 named crawlers it reads robots.txt, then fetches the homepage as that crawler. A row is a mismatch only when the control fetch loaded the page.
What if the control request is blocked?
Every crawler row is marked not comparable. Those rows are not treated as policy failures.
Does this call tools on an agent endpoint?
No. A high finding requires a JSON tool list with no login. An HTML page or a soft 404 is not an open agent.
What does the daily watch cost?
AI Access Watch is $9 per origin per month or $90 per year. The first day is quiet. Mail starts when a later day finds something new.