| Account usage | Current plan, successful and remaining monthly reads, request-rate usage, and both reset times. Usage checks do not consume a monthly read. | Free | benchlm_get_usageGET /v1/usage |
|---|
| Model recommendation | Up to ten models in the order of one BenchAlign ranking surface, filtered by use case, price caps, open weights, context window, one or several creators, or tags such as free API, self-hostable, or the lab’s country. A model whose lab has shut down its own API is left out unless you ask for it, and the answer names the ones it left out; so is a model whose replacement is also a candidate in the same answer, unless you ask for it. Each pick carries its url, score, rank, evidence status, list price, context window, and tags; a pick with a provider retirement notice or a successor says so. The response names the surface and its limits, and lists models it could not check because data is missing. Give monthly token volumes to get dollars a month per model. | Free | benchlm_recommendGET /v1/recommend |
|---|
| Model comparison | Two to five models side by side: rank, score, and evidence status on every surface, list price, context window, open-weight flag, license, lab origin, tags, successors, provider deprecation and retirement notices, self-host sizing, the Ollama tag, and release date. Two models also return the comparison page url. Give monthly token volumes to get dollars a month per model. | Free | benchlm_compare_modelsGET /v1/compare?modelKeys=a,b |
|---|
| Value board | The efficient pick, the cheapest model scoring at least 90% of the top score (retention sets the share), then models ranked by score per dollar on one surface: valueIndex is the score divided by the blended, input, or output price, with the formula stated in the response. Each row says whether it is on the price-performance frontier. Filter by minimum score, price cap, open weights, one or several creators, or tags, and leave out tagged models such as retired ones. Models without a price are listed as not evaluated; free models are listed separately and never ranked by division. | Free | benchlm_value_boardGET /v1/value |
|---|
| Model feed | A paged feed for routers and dashboards: every ranked model with open-weight flag, license, lab country, tags, successors, provider deprecation and retirement notices with their dates and named replacements, context window, overall and per-surface ranks, current input, output, and cached-input prices, and its url. Filter on the server by creator and tags, for example the free models plus the labs you choose, and leave out models the lab has retired or replaced. Up to 250 models per page. | Free | benchlm_model_feed/mcp/fullGET /v1/feed/models |
|---|
| Current BenchAlign rankings | Final scores, published ranks, supported-only ranks, evidence labels and routes, maturity labels, interval bounds, scoring date, and methodology version for Overall, Agentic, Coding, Knowledge, Reasoning, and Multimodal (preliminary). Regional models are listed separately. | Free | benchlm_list_current_rankingsGET /v1/rankings/current |
|---|
| Current model rankings | One model’s final score and rank across every available BenchAlign surface, with explicit gaps where it is unranked. | Free | benchlm_get_current_model_rankingsGET /v1/models/{identifier}/rankings/current |
|---|
| BenchAlign scoring basket | The benchmarks behind the current BenchAlign scores: category, benchmark, share of the category reference weight, and any exclusion reason. Results evaluated by external leaderboards appear as one combined line per category. | Free | benchlm_get_benchalign_basket/mcp/fullGET /v1/rankings/methodology |
|---|
| Model API prices | Current and launch list prices in USD for input, output, and cached input, per 1M tokens or the model’s own unit, with dates and the quoted source page. Prices come from the model’s lab or, for open weights its lab does not sell, one named host. | Free | benchlm_list_model_pricingGET /v1/pricing |
|---|
| Inference host prices | Where a model can be called by API and what each host charges: the per-token list price ten inference hosts and routers show on their own sites, with the host’s model ID, context window, status, the day the list was read, and its source page. One model across hosts, cheapest first, or one host’s whole list. A host flavor of a model (quantized, turbo, fast) is marked as a variant. These are single readings of each price list, with no history. | Free | benchlm_list_host_prices/mcp/fullGET /v1/pricing/hosts |
|---|
| Free tiers and subscription plans | Whether a provider has a free API tier, a signup credit, or only a paid entry tier, with its published rate limits and what moves an account up; and the monthly plans for Claude, ChatGPT, Gemini, and coding tools, with price, included usage in the provider’s words, caps, and the models each plan names. Every row is copied from the provider’s page with the day it was read. Filter by provider, type, a model, or a monthly price cap. | Free | benchlm_list_access_plans/mcp/fullGET /v1/plans |
|---|
| Image, video, speech, and music prices | What media models cost in the unit each is billed in: per image, per second of video, per minute of audio, per character of speech, or per song. One row per published variant (tier, resolution, duration), in USD as the provider lists it, with the API model ID, the day the page was read, and its source. Rows are grouped by modality and unit and never converted into tokens; a price kept after a provider shut a model down is marked historical. | Free | benchlm_list_media_prices/mcp/fullGET /v1/pricing/media |
|---|
| Model price history | Dated price entries for a model or for all models: launch, change, and confirmed. A first-observed date means on or before that date. | All plans | benchlm_pricing_history/mcp/fullGET /v1/history/pricing |
|---|
| Model catalog | Names, creators, canonical IDs, source links, sourced release dates with their date precision, license, lab origin (country and region), the model each one replaced and the models that replaced it, provider deprecation and retirement notices, self-host sizing for open weights (parameters and the GPU sets the weights fit on), the Ollama tag and pull command where Ollama carries the model, the input and output types the provider documents (text, image, audio, video, PDF) where BenchLM has recorded them, and tags for open weights, license class, self-hosting, Ollama, hosted API, free API, origin, reasoning, input and output types, and lifecycle. Search by name, filter by creator and tags, or leave tagged models out. | Free | benchlm_list_modelsbenchlm_get_modelGET /v1/modelsGET /v1/models/{identifier} |
|---|
| Benchmark catalog | Names, catalog IDs, source references, and curator categories and tags. Search by name or filter by category, tag, and relationship; discovery labels do not establish result coverage. | Free | benchlm_list_benchmarksGET /v1/benchmarks |
|---|
| Current benchmark results | All admitted current source results, with native units and exact profiles. Sources include 141 Arena leaderboards, Epoch AI, BullshitBench v2, tables from provider model cards, and results a model’s own lab reported, on separate unranked boards. Search by category or model name. Rows on BenchLM’s recorded boards say who ran the test, and you can filter by it. | Free | benchlm_list_current_benchmark_resultsGET /v1/benchmarks/results/current |
|---|
| Benchmark result coverage | Available source boards, row counts, metrics, units, and source terms, with each BenchLM recorded board’s rows counted by who ran the test. Search boards by word or benchmark key. Coverage checks do not use a read. | Free | benchlm_benchmark_result_coverageGET /v1/benchmarks/results/coverage |
|---|
| Published evaluation runs | Source-reported benchmark runs for an exact board and model profile. Run dates are distinct from archive commit dates; undated records are identified. | All plans | benchlm_benchmark_result_history/mcp/fullGET /v1/history/benchmark_results |
|---|
| Published benchmark snapshots | Follow an exact source model’s published rating, rank, and confidence interval over time. Arena snapshots keep the publisher’s dates, and scoring methods stay separate. | All plans | benchlm_benchmark_result_snapshot_history/mcp/fullGET /v1/history/benchmark_result_snapshots |
|---|
| One model across result boards | A model’s published scores and ranks on every result board where its source profile has a reviewed match, from one catalog model ID. | All plans | benchlm_model_result_history/mcp/fullGET /v1/history/benchmark_result_snapshots?modelKey= |
|---|
| What changed since a date | Models that entered or left a ranking surface, the largest rank moves, price changes, and rescoring events since a date, in one call. Moves across a rescoring are kept apart from model changes. | All plans | benchlm_changesGET /v1/changes?since= |
|---|
| Historical coverage | Available methods, retained date windows, and delivery coverage. Check this before requesting history. | Free | benchlm_history_coverage/mcp/fullGET /v1/coverage |
|---|
| BenchAlign history | Saved BenchLM scores, ranks, evidence labels, ranking surfaces, and methodology versions for an exact model. | All plans | benchlm_rank_history/mcp/fullGET /v1/history/rank_history |
|---|
| Ranking at a date | Stored BenchAlign ranking rows as of a UTC date. The response identifies incomplete coverage and preserves the saved scoring version. | All plans | benchlm_ranking_snapshot/mcp/fullGET /v1/history/ranking_snapshot |
|---|
| Benchmark history | Cleared measurements for an exact model, benchmark, and protocol. Availability differs by source; this is not every score on the website. | All plans | benchlm_benchmark_history/mcp/fullGET /v1/history/benchmark_history |
|---|
| Benchmark changes | First recorded catalog definitions and results, additions, removals, and reintroductions where retained. | All plans | benchlm_benchmark_events/mcp/fullGET /v1/history/benchmark_events |
|---|
| Feedback on missing data | Tell BenchLM which model, benchmark or use case the data could not answer, or what looks wrong. Your assistant can send it for you. It does not use a monthly read. | Free | benchlm_feedbackPOST /v1/feedback |
|---|