Agent Web Census
org.datacensus/agents · v0.1.0 · MCP 2025-11-25
Open data on MCP servers (with live health) and which AI crawlers top websites block.
Reachability
reachable
checked 2026-11-21 05:32 UTC
Registry status active
Tools pinned 4
49ad54c9f2a0
Tools last changed
unchanged since first capture 2026-11-20
Repo last push 2026-11-20
as of 2026-11-21
GitHub stars 0
as of 2026-11-21
Provenance
Registry namespace org.datacensus
(domain verified by the official registry)
Repository
github.com/jirizaloudek/agentwebcensus
Website
https://agents.datacensus.org
Remote endpoints
https://datacensus.org/mcp (streamable-http)
Observed changes
| When (UTC) | Event | Detail |
|---|---|---|
| 2026-11-20 05:31 | first capture | 4 tools pinned |
Pinned tool definitions (4)
| Tool | Description |
|---|---|
| find_mcp_servers | Search the official MCP Registry (~65,000 servers) by keyword. Matches name, title and description; ranks servers whose remote endpoint passed a live initialize check first, then by number of tools. Returns name, title, description,... |
| mcp_ecosystem_stats | Headline numbers of the MCP ecosystem: servers in the official registry, new servers in the last 7/30 days, remote vs package share, top package registries and categories, plus the weekly health check of remote servers (share working,... |
| site_ai_crawler_policy | Which AI crawlers does a website block in robots.txt? Looks up a domain in our scan of the top 10,000 websites (Tranco list) and returns, per AI bot (GPTBot, ClaudeBot, Google-Extended, PerplexityBot, ...), whether it is blocked, partly... |
| ai_crawler_stats | Aggregate AI-crawler blocking statistics across the top 10,000 websites: percentage of sites with a reachable robots.txt that fully block, partly restrict or explicitly allow each AI bot. Give a bot name for one bot, or omit for the... |
Get alerted when this changes.
Email the moment org.datacensus/agents drifts, dies, or revives.
Status badge
[](https://toolpin.dev/servers/org.datacensus/agents)
Maintain this server? Add the badge to your README. It links your users to this live status page.