AI Crawlability Check
io.github.Milan344s/ai-crawlability-check · v2.0.0 · MCP 2025-11-25
Check if AI crawlers like GPTBot and ClaudeBot can reach, index and quote any web page.
Reachability
reachable
checked 2026-11-21 05:32 UTC
Registry status active
Tools pinned 5
123f937ddde4
Tools last changed
unchanged since first capture 2026-11-20
Repo last push 2026-11-19
as of 2026-11-21
GitHub stars 1
as of 2026-11-21
Provenance
Registry namespace io.github.Milan344s
(GitHub-account verified by the official registry)
Repository
github.com/milan344s/ai-crawlability-check
Remote endpoints
https://mcp.milan-novotny.com/mcp (streamable-http)
Observed changes
| When (UTC) | Event | Detail |
|---|---|---|
| 2026-11-20 05:31 | first capture | 5 tools pinned |
Pinned tool definitions (5)
| Tool | Description |
|---|---|
| check_ai_crawler_access | Reports which AI crawlers may fetch a public URL. Reads the site's robots.txt and returns allowed or blocked, with the deciding rule, for each known AI crawler from OpenAI, Anthropic, Perplexity, Google, Microsoft, Apple, Meta, Amazon... |
| check_ai_indexability | Checks whether a public page can be indexed by search and AI engines once a crawler reaches it. Measures HTTP status and redirects, noindex, canonical target, how much copy exists in the raw HTML without JavaScript, client-side... |
| check_ai_citability | Fetches a public page and scores how quotable its content is for AI engines once it is crawled and indexed. Measures answer-first structure, question headings, lists and tables, FAQ, paragraph and sentence length, statistic and source... |
| check_seo_basics | Fetches a public page and runs 24 measurable on-page SEO checks: title and meta description length, H1, heading hierarchy, keyword placement and density, slug, canonical, internal and external links, anchor text, image alt text, schema... |
| get_review_rubric | Returns a scoring rubric as text for the judgment items the URL tools cannot measure: geo (would an AI engine quote this article?) or seo (pre-publish SEO review). Fetches nothing. |
Get alerted when this changes.
Email the moment io.github.Milan344s/ai-crawlability-check drifts, dies, or revives.
Status badge
[](https://toolpin.dev/servers/io.github.Milan344s/ai-crawlability-check)
Maintain this server? Add the badge to your README. It links your users to this live status page.