Toolpin Monitor a server

AI Crawlability Check

io.github.Milan344s/ai-crawlability-check · v2.0.0 · MCP 2025-11-25

Check if AI crawlers like GPTBot and ClaudeBot can reach, index and quote any web page.

Reachability reachable
checked 2026-11-21 05:32 UTC
Registry status active
Tools pinned 5
123f937ddde4
Tools last changed unchanged since first capture 2026-11-20
Repo last push 2026-11-19
as of 2026-11-21
GitHub stars 1
as of 2026-11-21

Provenance

Registry namespace io.github.Milan344s (GitHub-account verified by the official registry)
Repository github.com/milan344s/ai-crawlability-check
Website https://www.milan-novotny.com/tools/ai-crawlability-mcp/
Remote endpoints
https://mcp.milan-novotny.com/mcp (streamable-http)

Observed changes

When (UTC)EventDetail
2026-11-20 05:31 first capture 5 tools pinned

Pinned tool definitions (5)

ToolDescription
check_ai_crawler_access Reports which AI crawlers may fetch a public URL. Reads the site's robots.txt and returns allowed or blocked, with the deciding rule, for each known AI crawler from OpenAI, Anthropic, Perplexity, Google, Microsoft, Apple, Meta, Amazon...
check_ai_indexability Checks whether a public page can be indexed by search and AI engines once a crawler reaches it. Measures HTTP status and redirects, noindex, canonical target, how much copy exists in the raw HTML without JavaScript, client-side...
check_ai_citability Fetches a public page and scores how quotable its content is for AI engines once it is crawled and indexed. Measures answer-first structure, question headings, lists and tables, FAQ, paragraph and sentence length, statistic and source...
check_seo_basics Fetches a public page and runs 24 measurable on-page SEO checks: title and meta description length, H1, heading hierarchy, keyword placement and density, slug, canonical, internal and external links, anchor text, image alt text, schema...
get_review_rubric Returns a scoring rubric as text for the judgment items the URL tools cannot measure: geo (would an AI engine quote this article?) or seo (pre-publish SEO review). Fetches nothing.
Get alerted when this changes. Email the moment io.github.Milan344s/ai-crawlability-check drifts, dies, or revives.

Status badge

Toolpin status badge for io.github.Milan344s/ai-crawlability-check

[![Toolpin](https://toolpin.dev/badge/io.github.Milan344s/ai-crawlability-check.svg)](https://toolpin.dev/servers/io.github.Milan344s/ai-crawlability-check)

Maintain this server? Add the badge to your README. It links your users to this live status page.