Toolpin Monitor a server

LLMBenchmark.ai

ai.llmbenchmark/llmbenchmark · v1.0.1 · MCP 2026-07-28

Which LLM for which task: benchmark scores and API prices for 400+ models. Free, no key.

Reachability reachable
checked 2026-11-21 05:32 UTC
Registry status active
Tools pinned 6
c0a7234db0cd
Tools last changed unchanged since first capture 2026-11-20
Repo last push 2026-11-19
as of 2026-11-21
GitHub stars 0
as of 2026-11-21

Provenance

Registry namespace ai.llmbenchmark (domain verified by the official registry)
Repository github.com/take-group/llmbenchmark-mcp
Website https://llmbenchmark.ai/api
Remote endpoints
https://api.llmbenchmark.ai/mcp (streamable-http)

Observed changes

When (UTC)EventDetail
2026-11-20 05:31 first capture 6 tools pinned

Pinned tool definitions (6)

ToolDescription
recommend_model Which model should I use for this task? Maps the task text to a category (coding, agentic, reasoning, math, knowledge, web design, or overall when nothing matches) by a fixed keyword map, filters by output price per million...
get_leaderboard The top models on one category's board. category is one of overall, coding, agentic, reasoning, math, knowledge, design (see list_categories). limit is 1 to 50. overall is the LLMBenchmark Index: a weighted mean of the Vibe...
compare_models Two models side by side: score on every category board where both were measured, prices, context. Names are matched loosely: 'claude opus', 'gpt-5' or a slug all work.
get_model One model: maker, release date, prices, context, open weights, and its score and rank on every category board. Name or slug.
get_prices API prices (USD per million tokens), cheapest output price first: the maker's own price when it serves the model on OpenRouter, else the median of providers (price_basis says which), plus the cheapest provider. Filter by model name...
list_categories The categories recommend_model and get_leaderboard know, the benchmark board behind each, and the task keywords that select it.
Get alerted when this changes. Email the moment ai.llmbenchmark/llmbenchmark drifts, dies, or revives.

Status badge

Toolpin status badge for ai.llmbenchmark/llmbenchmark

[![Toolpin](https://toolpin.dev/badge/ai.llmbenchmark/llmbenchmark.svg)](https://toolpin.dev/servers/ai.llmbenchmark/llmbenchmark)

Maintain this server? Add the badge to your README. It links your users to this live status page.