com.lumnika/ai-crawler-readiness
com.lumnika/ai-crawler-readiness · v1.0.0 · MCP 2025-06-18
Can AI crawlers read this site? GPTBot/ClaudeBot verdicts, robots vs edge blocking, 47k-domain index
Reachability
reachable
checked 2026-09-20 05:30 UTC
Registry status active
Tools pinned 5
1c841377d8ec
Tools last changed
unchanged since first capture 2026-09-20
Provenance
Registry namespace com.lumnika
(domain verified by the official registry)
Remote endpoints
https://shop.lumnika.com/ai-readiness/mcp (streamable-http)
Observed changes
| When (UTC) | Event | Detail |
|---|---|---|
| 2026-09-20 05:30 | first capture | 5 tools pinned |
Pinned tool definitions (5)
| Tool | Description |
|---|---|
| domain_readiness | Can AI assistants actually read this domain? Returns the measured readiness score, the per-crawler verdict (served / blocked in robots.txt / refused by the edge despite robots.txt allowing it), and which edge vendor answers for the... |
| web_openness | How much of the most-visited web is readable by AI assistants right now: the share of measured domains that block at least one AI crawler, and the served / robots-blocked / edge-blocked breakdown per crawler. |
| edge_blocking | Who is actually doing the blocking: for each CDN/WAF vendor, the share of (domain x crawler) pairs that robots.txt ALLOWS and the server refuses anyway — i.e. how much of the blocking is an infrastructure default rather than a decision... |
| recent_changes | What CHANGED: the domains that recently started or stopped blocking a specific AI crawler, with the day the flip was observed and whether it happened in robots.txt or at the edge. This cannot be reconstructed after the fact from any... |
| measure_domain | Measure a domain RIGHT NOW instead of reading the archive: 9 real HTTP requests, one from a browser user-agent and one per AI crawler user-agent, plus robots.txt / llms.txt / sitemap. Use it for any site the index has not reached yet,... |
Get alerted when this changes.
Email the moment com.lumnika/ai-crawler-readiness drifts, dies, or revives.
Status badge
[](https://toolpin.dev/servers/com.lumnika/ai-crawler-readiness)
Maintain this server? Add the badge to your README. It links your users to this live status page.