Data as of November 9, 2026 · How the score is built
Released Nov 2, 20261M contextMeituan LongCat-2.5 model card
LongCat-2.5
Decision readingLongCat-2.5 is tracked, but not publicly ranked yet. The profile exposes 25 sourced benchmark rows and leaves unsupported fields blank until a published record exists.
Released Nov 2, 2026 — see all recent releases
Decision snapshot
Each value carries a field reference instead of floating alone. Markers compare this model with the current ranked and priced catalog; they are not absolute quality thresholds.
Capability
Unranked
field median 51.1Not eligible for a public rank
Price
$0.30input / $1.20 output
input median $0.60cached $0.006 · blended $0.75
Speed
Not measured
field median 92 tok/sTime to first token not measured
Context
1Mtokens
field median 256,000Maximum output length is tracked separately
Strongest published evidence
Published rows are visible, but no category has enough eligible evidence for a comparative rank.
Validate before choosing
25 published rows leave some tracked benchmark slots empty. Independent runtime speed has not been measured.
Source-linked · 25 displayable benchmark rows
Category score record
Scores and ranks appear only where published evidence can be displayed. The table keeps the score, weight, cohort, and evidence state together.
| Category | Score | Rank | Percentile | Weight | Benchmarks | Evidence |
|---|---|---|---|---|---|---|
| AgenticRank Not rankedWeight 22%11 benchmarksVerified | 83.8 | 11 benchmarks | Verified | |||
| CodingWeight 20%6 benchmarksVerified | Score pending | 6 benchmarks | Verified | |||
| ReasoningWeight 17%0 benchmarksNot measured | Not measured | 0 benchmarks | Not measured | |||
| MultimodalRank Not rankedWeight 12%4 benchmarksVerified | 83.1 | 4 benchmarks | Verified | |||
| KnowledgeWeight 12%1 benchmarkVerified | Score pending | 1 benchmark | Verified | |||
| MultilingualWeight 7%0 benchmarksNot measured | Not measured | 0 benchmarks | Not measured | |||
| Inst. FollowingWeight 5%0 benchmarksNot measured | Not measured | 0 benchmarks | Not measured | |||
| MathWeight 5%0 benchmarksNot measured | Not measured | 0 benchmarks | Not measured |
25 of 848 tracked benchmark slots have displayable evidence · bars run 0–100
Coverage detailsHow much of this is verified
Coverage is split by category so a strong number never hides a thin evidence base. Verified means the row is tied to a published source; provisional rows remain visible but separate.
- Agentic11/11 verified
- Coding6/6 verified
- ReasoningNot measured
- Multimodal4/4 verified
- Knowledge1/1 verified
- MultilingualNot measured
- Inst. FollowingNot measured
- MathNot measured
Benchmark ledger
Coding opens by default. The marker compares each value with the best source-verified result in the catalog; provisional leaders do not set the reference. Expand the remaining categories for every published row.
Coding6 rows
| Benchmark | Score | Versus best verified row | Gap | Weight | Evidence |
|---|---|---|---|---|---|
| DeepSWE | Score64.6% | Versus best verified row Best verified: Muse Wonder Full · 79.0% | Gap14.4 behind | WeightDisplay only | Provider exact |
| Terminal-Bench 2.1 | Score88.4% | Versus best verified row Best verified: SWE-2 · 92.8% | Gap4.4 behind | WeightDisplay only | Provider exact |
| ProgramBenchProgramBench: Can Language Models Rebuild Programs From Scratch? | Score25.5% | Versus best verified row Best verified: Claude Opus 5 · 93.0% | Gap67.5 behind | WeightDisplay only | Provider exact |
| PaperBench | Score82.1% | Versus best verified row Best verified: Qwen3.8 Max · 93.0% | Gap10.9 behind | WeightDisplay only | Provider exact |
| SWE-Atlas Codebase QnA | Score58.3% | Versus best verified row Best verified: Ling 3.1 Flash · 64.5% | Gap6.2 behind | WeightDisplay only | Provider exact |
| NL2Repo | Score60.5% | Versus best verified row Best verified: DeepSeek V4.1 Flash 1017 · 68.2% | Gap7.7 behind | WeightDisplay only | Provider exact |
Agentic11 rows
| Benchmark | Score | Versus best verified row | Gap | Weight | Evidence |
|---|---|---|---|---|---|
| Terminal-Bench 2.1 | Score88.4% | Versus best verified row Best verified: SWE-2 · 92.8% | Gap4.4 behind | WeightDisplay only | Provider exact |
| Terminal-Bench 4.0 | Score38.50% | Versus best verified row Best verified: Claude Sonnet 5.5 · 70.60% | Gap32.1 behind | WeightDisplay only | Provider exact |
| BrowseComp | Score91.9% | Versus best verified row Best verified: Atria Dawn Preview · 92.5% | Gap0.6 behind | WeightDisplay only | Provider exact |
| AutomationBench | Score51.8% | Versus best verified row Best verified: MiniMax M3.1 Flash · 62.2% | Gap10.4 behind | WeightDisplay only | Provider exact |
| JobBench | Score65.4% | Versus best verified row Best verified: Muse Wonder Full · 75.3% | Gap9.9 behind | WeightDisplay only | Provider exact |
| MCP Atlas | Score83.1% | Versus best verified row Best verified: Muse Spark Open · 89.2% | Gap6.1 behind | WeightDisplay only | Provider exact |
| HLE w/ toolsHumanity's Last Exam with tools | Score63.1% | Versus best verified row Best verified: Kimi K3.1 Pro · 70.0% | Gap6.9 behind | WeightDisplay only | Provider exact |
| Agents' Last Exam | Score38.5% | Versus best verified row Best verified: GPT-6.1 Terra · 60.0% | Gap21.5 behind | WeightDisplay only | Provider exact |
| skillsBench | Score63.3% | Versus best verified row Best verified: Qwen3.8 Max · 70.2% | Gap6.9 behind | WeightDisplay only | Provider exact |
| SpreadsheetBench 2 | Score34.9% | Versus best verified row Best verified: LongCat-2.5 · 34.9% | GapBest verified | WeightDisplay only | Provider exact |
| Claw-Eval | Score78.3% | Versus best verified row Best verified: Ornith-1.5-397B · 81.4% | Gap3.1 behind | WeightDisplay only | Provider exact |
Multimodal4 rows
| Benchmark | Score | Versus best verified row | Gap | Weight | Evidence |
|---|---|---|---|---|---|
| CharXivCharXiv Reasoning | Score90.2% | Versus best verified row Best verified: Qwen3.8 Max · 93.5% | Gap3.3 behind | WeightDisplay only | Provider exact |
| Vision2Web | Score78.6% | Versus best verified row Best verified: LongCat-2.5 · 78.6% | GapBest verified | WeightDisplay only | Provider exact |
| MathVision w/ PythonMathVision with Python | Score96.5% | Versus best verified row Best verified: Kimi K3 · 97.8% | Gap1.3 behind | WeightDisplay only | Provider exact |
| Video-MME | Score85.2% | Versus best verified row Best verified: Seed 2.1 Pro · 89.2% | Gap4 behind | WeightDisplay only | Provider exact |
Knowledge1 row
| Benchmark | Score | Versus best verified row | Gap | Weight | Evidence |
|---|---|---|---|---|---|
| FrontierScience | Score77% | Versus best verified row Best verified: LongCat-2.5 · 77% | GapBest verified | WeightDisplay only | Provider exact |
External signals3 rows
| Benchmark | Score | Versus best verified row | Gap | Weight | Evidence |
|---|---|---|---|---|---|
| ResearchRubricsResearchRubrics: A Benchmark of Prompts and Rubrics for Evaluating Deep Research Agents | Score81.0% | Versus best verified row Best verified: LongCat-2.5 · 81.0% | GapBest verified | WeightDisplay only | Provider exact |
| FinSearchComp (T3)FinSearchComp Task 3: Complex Historical Investigation | Score63.4% | Versus best verified row Best verified: LongCat-2.5 · 63.4% | GapBest verified | WeightDisplay only | Provider exact |
| 3DCodeBench (Text to 3D)3DCodeBench: Benchmarking Agentic Procedural 3D Modeling via Code (text-to-3D) | Score55.4% | Versus best verified row Best verified: LongCat-2.5 · 55.4% | GapBest verified | WeightDisplay only | Provider exact |
Bars run 0–100; the dark tick marks the best source-verified value
All 25 rowsLineage
The sequence follows explicit supersedes links. Each score is estimated for that model; a relative can inform a sparse estimate but never sets a floor, so a newer release can score below an earlier one. Scores and prices remain blank when the corresponding public row or first-party rate is unavailable.
Base entry
Spec sheet
Each documented value carries its source. Missing fields stay visible as not sourced or not published, rather than disappearing from the page.
- API model ID
- LongCat-2.5LongCat API Platform pricing
- Context window
- 1MLongCat API Platform pricing
- Maximum output
- Not sourced yet
- Knowledge cutoff
- Not sourced yet
- Input modalities
- Not sourced yet
- Output modalities
- Not sourced yet
- Parameters
- Not sourced yet
- Availability
- Meituan published MIT-licensed weights on Hugging Face (meituan-longcat/LongCat-2.5, 208 safetensors shards), with NPU deployment through SGLang-FluentLLM and W4A4 expert quantization for domestic accelerators. The LongCat API Platform added LongCat-2.5 on November 2, 2026 (OpenAI and Anthropic formats, model id LongCat-2.5, 1M-token context, 256K max output) at a limited-time discounted pay-as-you-go price of $0.30 uncached input, $0.006 cached input and $1.20 output per million tokens; it is now the only pay-as-you-go model on the platform. Input: text, images and video.
- Cloud regions
- Not tracked yet
- Lifecycle
- Current
- API capabilities
- Tool calling, structured outputs, and batch support are not tracked yet
- Prompt caching
- Published at $0.006 per million cached input tokensLongCat API Platform pricing
- Self-host
- LongCat-2.5 needs ~1536GB VRAM (8× NVIDIA B200 (192GB)).
- Rate limits
- Not tracked yet
How to read this profile
The visual layer above carries the decisions. These notes preserve the model, ranking, coverage, and family context behind the numbers.
We track LongCat-2.5, but the public leaderboard excludes this profile until enough non-generated benchmark coverage is available. Only published rows appear above.
LongCat-2.5 is a open weight model with a 1M context window. No explicit reasoning mode is documented in this profile.
Meituan published MIT-licensed weights on Hugging Face (meituan-longcat/LongCat-2.5, 208 safetensors shards), with NPU deployment through SGLang-FluentLLM and W4A4 expert quantization for domestic accelerators. The LongCat API Platform added LongCat-2.5 on November 2, 2026 (OpenAI and Anthropic formats, model id LongCat-2.5, 1M-token context, 256K max output) at a limited-time discounted pay-as-you-go price of $0.30 uncached input, $0.006 cached input and $1.20 output per million tokens; it is now the only pay-as-you-go model on the platform. Input: text, images and video.
Official exact-value snapshot from Meituan's LongCat-2.5 Hugging Face model card and launch blog. LongCat-2.5 builds on LongCat-2.0 as a native multimodal MoE with 1.6T total and about 48B activated parameters per token, with discrete visual tokens learned jointly with text and long-horizon agentic RL. All LongCat-2.5 rows use thinking mode at temperature 1.0 and top_p 0.95, and Meituan calls its in-house scores indicative only. Harnesses: Claude Code for Terminal-Bench 2.1 and 4.0, ProgramBench (almost-resolved), NL2Repo, SWE-Atlas Codebase QnA, HLE with tools (text-only subset), JobBench and SpreadsheetBench 2; mini-swe-agent for DeepSWE v1.1; a custom search harness for BrowseComp; Codex for SkillsBench v1.1 (87 tasks); the official code for AutomationBench public v1.0.6 (600 tasks). Every row is provider-run, so the model stays display-only and outside rankings. BenchLM adds display-only pages for ResearchRubrics, FinSearchComp (T3) and 3DCodeBench (Text to 3D) from this launch. SWE-Atlas Refactoring and Test Writing are left to the Scale leaderboards BenchLM mirrors, and the internal LongCat AppDev and LongCatClawBench (FORTE, FORTE-MM) suites plus PosterBench (protocol not published for language models) are not mapped.
Its explicit predecessor is LongCat-2.0. 25 of 848 tracked benchmark slots currently have displayable evidence. Missing categories stay blank.
Last updated November 9, 2026. Runtime fields remain blank until a sourced snapshot exists.
Deployment options
Self-host and provider-specific paths stay separate from benchmark evidence so operating constraints are visible before a score becomes the whole decision.
Self-host vs API cost
Estimates at 50,000 req/day · 1000 tokens/req average.
Ask your AI, from current BenchLM data
Where does LongCat-2.5 rank right now, and what does it cost?
Questions
How does LongCat-2.5 perform overall in AI benchmarks?
LongCat-2.5 has 25 source-displayable benchmark rows, but it does not qualify for a public overall rank. The available rows remain visible by category without being converted into a site-wide score. Missing evidence stays blank instead of being estimated from an earlier model.
Is LongCat-2.5 good for knowledge and understanding?
LongCat-2.5 has source-displayable benchmark coverage for knowledge and understanding, but the public category table does not assign it a rank there. The individual rows remain available for inspection. A missing category position means the evidence threshold was not met; it does not convert the model's unmeasured work into a zero.
Is LongCat-2.5 good for coding and programming?
LongCat-2.5 has source-displayable benchmark coverage for coding and programming, but the public category table does not assign it a rank there. The individual rows remain available for inspection. A missing category position means the evidence threshold was not met; it does not convert the model's unmeasured work into a zero.
Is LongCat-2.5 good for agentic tool use and computer tasks?
LongCat-2.5 has source-displayable benchmark coverage for agentic tool use and computer tasks, but the public category table does not assign it a rank there. The individual rows remain available for inspection. A missing category position means the evidence threshold was not met; it does not convert the model's unmeasured work into a zero.
Is LongCat-2.5 good for multimodal and grounded tasks?
LongCat-2.5 has source-displayable benchmark coverage for multimodal and grounded tasks, but the public category table does not assign it a rank there. The individual rows remain available for inspection. A missing category position means the evidence threshold was not met; it does not convert the model's unmeasured work into a zero.
Is LongCat-2.5 open source?
LongCat-2.5 is an open-weight model from Meituan. Its weights can be downloaded for local or hosted deployment, subject to the published license. Open weight does not automatically mean open source: training data and training code may remain private, and commercial restrictions can still apply.
Does LongCat-2.5 have full benchmark coverage on BenchLM?
No. LongCat-2.5 currently has 26 source-displayable rows. The profile exposes published, non-generated evidence and leaves missing categories blank until an exact evaluation is available. Coverage describes how much was measured; it is not a penalty added to an individual benchmark result.
What is the context window size of LongCat-2.5?
LongCat-2.5 has a documented context window of 1M. That figure is the maximum combined prompt and retained-conversation space reported for this exact model; it is not the maximum output length. The profile keeps output limits separate because providers often publish those limits independently.