Skip to main content
BenchLM
Data

Data as of November 9, 2026 · How the score is built

LongCat-2.5

Decision readingLongCat-2.5 is tracked, but not publicly ranked yet. The profile exposes 25 sourced benchmark rows and leaves unsupported fields blank until a published record exists.

Released Nov 2, 2026 — see all recent releases

Decision snapshot

Each value carries a field reference instead of floating alone. Markers compare this model with the current ranked and priced catalog; they are not absolute quality thresholds.

Capability

Unranked

field median 51.1Not eligible for a public rank

Price

$0.30input / $1.20 output

input median $0.60cached $0.006 · blended $0.75

Speed

Not measured

field median 92 tok/sTime to first token not measured

Context

1Mtokens

field median 256,000Maximum output length is tracked separately

Strongest published evidence

Published rows are visible, but no category has enough eligible evidence for a comparative rank.

Validate before choosing

25 published rows leave some tracked benchmark slots empty. Independent runtime speed has not been measured.

Source-linked · 25 displayable benchmark rows

Category score record

Scores and ranks appear only where published evidence can be displayed. The table keeps the score, weight, cohort, and evidence state together.

Category scores, ranks, weighting, benchmark coverage, and evidence status
CategoryScore
AgenticRank Not rankedWeight 22%11 benchmarksVerified
83.8
CodingWeight 20%6 benchmarksVerified
Score pending
ReasoningWeight 17%0 benchmarksNot measured
Not measured
MultimodalRank Not rankedWeight 12%4 benchmarksVerified
83.1
KnowledgeWeight 12%1 benchmarkVerified
Score pending
MultilingualWeight 7%0 benchmarksNot measured
Not measured
Inst. FollowingWeight 5%0 benchmarksNot measured
Not measured
MathWeight 5%0 benchmarksNot measured
Not measured

25 of 848 tracked benchmark slots have displayable evidence · bars run 0–100

Coverage details

How much of this is verified

Coverage is split by category so a strong number never hides a thin evidence base. Verified means the row is tied to a published source; provisional rows remain visible but separate.

  1. Agentic11/11 verified
  2. Coding6/6 verified
  3. ReasoningNot measured
  4. Multimodal4/4 verified
  5. Knowledge1/1 verified
  6. MultilingualNot measured
  7. Inst. FollowingNot measured
  8. MathNot measured
Verified sourceProvisionalNot measured

Benchmark ledger

Coding opens by default. The marker compares each value with the best source-verified result in the catalog; provisional leaders do not set the reference. Expand the remaining categories for every published row.

Coding6 rows
Coding benchmark values, best verified comparison, weight, and source status
DeepSWEScore64.6%Versus best verified row

Best verified: Muse Wonder Full · 79.0%

Gap14.4 behindWeightDisplay only
Terminal-Bench 2.1Score88.4%Versus best verified row

Best verified: SWE-2 · 92.8%

Gap4.4 behindWeightDisplay only
ProgramBenchProgramBench: Can Language Models Rebuild Programs From Scratch?Score25.5%Versus best verified row

Best verified: Claude Opus 5 · 93.0%

Gap67.5 behindWeightDisplay only
PaperBenchScore82.1%Versus best verified row

Best verified: Qwen3.8 Max · 93.0%

Gap10.9 behindWeightDisplay only
SWE-Atlas Codebase QnAScore58.3%Versus best verified row

Best verified: Ling 3.1 Flash · 64.5%

Gap6.2 behindWeightDisplay only
NL2RepoScore60.5%Versus best verified row

Best verified: DeepSeek V4.1 Flash 1017 · 68.2%

Gap7.7 behindWeightDisplay only
Agentic11 rows
Agentic benchmark values, best verified comparison, weight, and source status
Terminal-Bench 2.1Score88.4%Versus best verified row

Best verified: SWE-2 · 92.8%

Gap4.4 behindWeightDisplay only
Terminal-Bench 4.0Score38.50%Versus best verified row

Best verified: Claude Sonnet 5.5 · 70.60%

Gap32.1 behindWeightDisplay only
BrowseCompScore91.9%Versus best verified row

Best verified: Atria Dawn Preview · 92.5%

Gap0.6 behindWeightDisplay only
AutomationBenchScore51.8%Versus best verified row

Best verified: MiniMax M3.1 Flash · 62.2%

Gap10.4 behindWeightDisplay only
JobBenchScore65.4%Versus best verified row

Best verified: Muse Wonder Full · 75.3%

Gap9.9 behindWeightDisplay only
MCP AtlasScore83.1%Versus best verified row

Best verified: Muse Spark Open · 89.2%

Gap6.1 behindWeightDisplay only
HLE w/ toolsHumanity's Last Exam with toolsScore63.1%Versus best verified row

Best verified: Kimi K3.1 Pro · 70.0%

Gap6.9 behindWeightDisplay only
Agents' Last ExamScore38.5%Versus best verified row

Best verified: GPT-6.1 Terra · 60.0%

Gap21.5 behindWeightDisplay only
skillsBenchScore63.3%Versus best verified row

Best verified: Qwen3.8 Max · 70.2%

Gap6.9 behindWeightDisplay only
SpreadsheetBench 2Score34.9%Versus best verified row

Best verified: LongCat-2.5 · 34.9%

GapBest verifiedWeightDisplay only
Claw-EvalScore78.3%Versus best verified row

Best verified: Ornith-1.5-397B · 81.4%

Gap3.1 behindWeightDisplay only
Multimodal4 rows
Multimodal benchmark values, best verified comparison, weight, and source status
CharXivCharXiv ReasoningScore90.2%Versus best verified row

Best verified: Qwen3.8 Max · 93.5%

Gap3.3 behindWeightDisplay only
Vision2WebScore78.6%Versus best verified row

Best verified: LongCat-2.5 · 78.6%

GapBest verifiedWeightDisplay only
MathVision w/ PythonMathVision with PythonScore96.5%Versus best verified row

Best verified: Kimi K3 · 97.8%

Gap1.3 behindWeightDisplay only
Video-MMEScore85.2%Versus best verified row

Best verified: Seed 2.1 Pro · 89.2%

Gap4 behindWeightDisplay only
Knowledge1 row
Knowledge benchmark values, best verified comparison, weight, and source status
FrontierScienceScore77%Versus best verified row

Best verified: LongCat-2.5 · 77%

GapBest verifiedWeightDisplay only
External signals3 rows
External signals benchmark values, best verified comparison, weight, and source status
ResearchRubricsResearchRubrics: A Benchmark of Prompts and Rubrics for Evaluating Deep Research AgentsScore81.0%Versus best verified row

Best verified: LongCat-2.5 · 81.0%

GapBest verifiedWeightDisplay only
FinSearchComp (T3)FinSearchComp Task 3: Complex Historical InvestigationScore63.4%Versus best verified row

Best verified: LongCat-2.5 · 63.4%

GapBest verifiedWeightDisplay only
3DCodeBench (Text to 3D)3DCodeBench: Benchmarking Agentic Procedural 3D Modeling via Code (text-to-3D)Score55.4%Versus best verified row

Best verified: LongCat-2.5 · 55.4%

GapBest verifiedWeightDisplay only

Bars run 0–100; the dark tick marks the best source-verified value

All 25 rows

Lineage

The sequence follows explicit supersedes links. Each score is estimated for that model; a relative can inform a sparse estimate but never sets a floor, so a newer release can score below an earlier one. Scores and prices remain blank when the corresponding public row or first-party rate is unavailable.

  1. Jun 30, 2026

    LongCat-2.0

    Not publicly ranked · Price not listed

  2. Nov 2, 2026 · you are here

    LongCat-2.5

    Not publicly ranked · $0.3 / $1.2

Base entry

Spec sheet

Each documented value carries its source. Missing fields stay visible as not sourced or not published, rather than disappearing from the page.

API model ID
LongCat-2.5LongCat API Platform pricing
Maximum output
Not sourced yet
Knowledge cutoff
Not sourced yet
Input modalities
Not sourced yet
Output modalities
Not sourced yet
Parameters
Not sourced yet
Availability
Meituan published MIT-licensed weights on Hugging Face (meituan-longcat/LongCat-2.5, 208 safetensors shards), with NPU deployment through SGLang-FluentLLM and W4A4 expert quantization for domestic accelerators. The LongCat API Platform added LongCat-2.5 on November 2, 2026 (OpenAI and Anthropic formats, model id LongCat-2.5, 1M-token context, 256K max output) at a limited-time discounted pay-as-you-go price of $0.30 uncached input, $0.006 cached input and $1.20 output per million tokens; it is now the only pay-as-you-go model on the platform. Input: text, images and video.
Cloud regions
Not tracked yet
Lifecycle
Current
API capabilities
Tool calling, structured outputs, and batch support are not tracked yet
Prompt caching
Published at $0.006 per million cached input tokensLongCat API Platform pricing
Self-host
LongCat-2.5 needs ~1536GB VRAM (8× NVIDIA B200 (192GB)).
Rate limits
Not tracked yet

How to read this profile

The visual layer above carries the decisions. These notes preserve the model, ranking, coverage, and family context behind the numbers.

We track LongCat-2.5, but the public leaderboard excludes this profile until enough non-generated benchmark coverage is available. Only published rows appear above.

LongCat-2.5 is a open weight model with a 1M context window. No explicit reasoning mode is documented in this profile.

Meituan published MIT-licensed weights on Hugging Face (meituan-longcat/LongCat-2.5, 208 safetensors shards), with NPU deployment through SGLang-FluentLLM and W4A4 expert quantization for domestic accelerators. The LongCat API Platform added LongCat-2.5 on November 2, 2026 (OpenAI and Anthropic formats, model id LongCat-2.5, 1M-token context, 256K max output) at a limited-time discounted pay-as-you-go price of $0.30 uncached input, $0.006 cached input and $1.20 output per million tokens; it is now the only pay-as-you-go model on the platform. Input: text, images and video.

Official exact-value snapshot from Meituan's LongCat-2.5 Hugging Face model card and launch blog. LongCat-2.5 builds on LongCat-2.0 as a native multimodal MoE with 1.6T total and about 48B activated parameters per token, with discrete visual tokens learned jointly with text and long-horizon agentic RL. All LongCat-2.5 rows use thinking mode at temperature 1.0 and top_p 0.95, and Meituan calls its in-house scores indicative only. Harnesses: Claude Code for Terminal-Bench 2.1 and 4.0, ProgramBench (almost-resolved), NL2Repo, SWE-Atlas Codebase QnA, HLE with tools (text-only subset), JobBench and SpreadsheetBench 2; mini-swe-agent for DeepSWE v1.1; a custom search harness for BrowseComp; Codex for SkillsBench v1.1 (87 tasks); the official code for AutomationBench public v1.0.6 (600 tasks). Every row is provider-run, so the model stays display-only and outside rankings. BenchLM adds display-only pages for ResearchRubrics, FinSearchComp (T3) and 3DCodeBench (Text to 3D) from this launch. SWE-Atlas Refactoring and Test Writing are left to the Scale leaderboards BenchLM mirrors, and the internal LongCat AppDev and LongCatClawBench (FORTE, FORTE-MM) suites plus PosterBench (protocol not published for language models) are not mapped.

Its explicit predecessor is LongCat-2.0. 25 of 848 tracked benchmark slots currently have displayable evidence. Missing categories stay blank.

Last updated November 9, 2026. Runtime fields remain blank until a sourced snapshot exists.

Deployment options

Self-host and provider-specific paths stay separate from benchmark evidence so operating constraints are visible before a score becomes the whole decision.

Self-host vs API cost

Estimates at 50,000 req/day · 1000 tokens/req average.

LongCat-2.5
API / mo$1,125
Self-host / mo$57,606
Break-even3.4B/day
Model the full break-even

Ask your AI, from current BenchLM data

Where does LongCat-2.5 rank right now, and what does it cost?

Connect BenchLM to your AI

Questions

How does LongCat-2.5 perform overall in AI benchmarks?

LongCat-2.5 has 25 source-displayable benchmark rows, but it does not qualify for a public overall rank. The available rows remain visible by category without being converted into a site-wide score. Missing evidence stays blank instead of being estimated from an earlier model.

Is LongCat-2.5 good for knowledge and understanding?

LongCat-2.5 has source-displayable benchmark coverage for knowledge and understanding, but the public category table does not assign it a rank there. The individual rows remain available for inspection. A missing category position means the evidence threshold was not met; it does not convert the model's unmeasured work into a zero.

Is LongCat-2.5 good for coding and programming?

LongCat-2.5 has source-displayable benchmark coverage for coding and programming, but the public category table does not assign it a rank there. The individual rows remain available for inspection. A missing category position means the evidence threshold was not met; it does not convert the model's unmeasured work into a zero.

Is LongCat-2.5 good for agentic tool use and computer tasks?

LongCat-2.5 has source-displayable benchmark coverage for agentic tool use and computer tasks, but the public category table does not assign it a rank there. The individual rows remain available for inspection. A missing category position means the evidence threshold was not met; it does not convert the model's unmeasured work into a zero.

Is LongCat-2.5 good for multimodal and grounded tasks?

LongCat-2.5 has source-displayable benchmark coverage for multimodal and grounded tasks, but the public category table does not assign it a rank there. The individual rows remain available for inspection. A missing category position means the evidence threshold was not met; it does not convert the model's unmeasured work into a zero.

Is LongCat-2.5 open source?

LongCat-2.5 is an open-weight model from Meituan. Its weights can be downloaded for local or hosted deployment, subject to the published license. Open weight does not automatically mean open source: training data and training code may remain private, and commercial restrictions can still apply.

Does LongCat-2.5 have full benchmark coverage on BenchLM?

No. LongCat-2.5 currently has 26 source-displayable rows. The profile exposes published, non-generated evidence and leaves missing categories blank until an exact evaluation is available. Coverage describes how much was measured; it is not a penalty added to an individual benchmark result.

What is the context window size of LongCat-2.5?

LongCat-2.5 has a documented context window of 1M. That figure is the maximum combined prompt and retained-conversation space reported for this exact model; it is not the maximum output length. The profile keeps output limits separate because providers often publish those limits independently.

Watch LongCat-2.5 in the weekly brief

Get one weekly email when material rank, price, availability, or benchmark evidence changes are worth revisiting.

Read a sample issue

Join 6,100+ subscribers.

Compare LongCat-2.5 with every tracked model1019 comparisons