# Kimi K2.5 vs BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI)

> Side-by-side benchmark comparison for Kimi K2.5 and BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) across agentic, coding, multimodal, knowledge, reasoning, multilingual, and math tasks.

- Canonical page: https://benchlm.ai/compare/kimi-k2-5-vs-native-contractnli-bert-base-fine-tuned-on-case-law-and-contract-corpora-chalkidis-et-al-2020
- Last updated: October 1, 2026

- Shared sourced benchmarks: 0
- HTML indexing: indexable
- Ranking lane: BenchAlign v5.8

## Quick Verdict

No benchmark verdict yet: there is no shared sourced benchmark row for Kimi K2.5 and BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI).

## Summary

- Kimi K2.5 and BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) do not currently share a sourced benchmark row. The mirror therefore compares metadata, pricing, context windows, and each model's separately reported coverage without naming a benchmark winner.

## Model Snapshot

| Property | Kimi K2.5 | BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) |
|----------|----------|----------|
| Creator | Moonshot AI | Koreeda and Manning |
| Type | Open Weight | Research system |
| Reasoning | Non-Reasoning | Unspecified |
| Context | 256K | null |
| Independent public score (not head-to-head) | 53.65 | null |
| Benchmarks Covered | 45 | 0 |
| Pricing (input/output) | $0.60 / $3.00 | Pricing unavailable / Pricing unavailable |

## Category Breakdown

### Agentic

- Winner: Insufficient shared evidence
- Kimi K2.5 public-lane score: 38 (Estimated · #63/119)
- BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) public-lane score: Coming soon

| Benchmark | Kimi K2.5 | BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) | Winner |
|-----------|-----------|-----------|--------|
| Terminal-Bench 2.0 | 50.8% | Coming soon | Coming soon |
| BrowseComp | 60.6% | Coming soon | Coming soon |
| Claw-Eval | 52.3% | Coming soon | Coming soon |
| QwenClawBench | 54.3% | Coming soon | Coming soon |
| τ³-bench results | 65.7% | Coming soon | Coming soon |
| DeepSearchQA | 77.1% | Coming soon | Coming soon |
| DeepPlanning | 14.4% | Coming soon | Coming soon |
| Toolathlon | 27.8% | Coming soon | Coming soon |
| MCP Atlas | 29.5% | Coming soon | Coming soon |
| MCP-Tasks | 59.1% | Coming soon | Coming soon |
| WideResearch | 72.7% | Coming soon | Coming soon |
| Gert Labs | 45.88% | Coming soon | Coming soon |
| ResearchClawBench | 14.0% | Coming soon | Coming soon |
| JobBench | 8.7% | Coming soon | Coming soon |

### Coding

- Winner: Insufficient shared evidence
- Kimi K2.5 public-lane score: 40.2 (Estimated · #64/144)
- BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) public-lane score: Coming soon

| Benchmark | Kimi K2.5 | BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) | Winner |
|-----------|-----------|-----------|--------|
| SWE-bench Verified | 76.8% | Coming soon | Coming soon |
| SWE-bench Verified* | 70.8% | Coming soon | Coming soon |
| LiveCodeBench v6 | 85.0% | Coming soon | Coming soon |
| SWE-bench Pro | 50.7% | Coming soon | Coming soon |
| SWE Multilingual | 73% | Coming soon | Coming soon |
| SWE-Rebench | 58.5% | Coming soon | Coming soon |
| React Native Evals | 77.2% | Coming soon | Coming soon |
| SciCode | 48.7% | Coming soon | Coming soon |

### Reasoning

- Winner: Insufficient shared evidence
- Kimi K2.5 public-lane score: 55.2 (Unranked · 3 rankable rows)
- BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) public-lane score: Coming soon

| Benchmark | Kimi K2.5 | BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) | Winner |
|-----------|-----------|-----------|--------|
| LongBench v2 | 61% | Coming soon | Coming soon |

### Multimodal & Grounded

- Winner: Insufficient shared evidence
- Kimi K2.5 public-lane score: 66.8 (#24/49)
- BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) public-lane score: Coming soon

| Benchmark | Kimi K2.5 | BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) | Winner |
|-----------|-----------|-----------|--------|
| MMMU-Pro | 78.5% | Coming soon | Coming soon |
| Video-MME | 87.4% | Coming soon | Coming soon |
| MMVU | 80.4% | Coming soon | Coming soon |
| VideoMMMU | 86.6% | Coming soon | Coming soon |

### Knowledge

- Winner: Insufficient shared evidence
- Kimi K2.5 public-lane score: 49.5 (Estimated · #66/170)
- BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) public-lane score: Coming soon

| Benchmark | Kimi K2.5 | BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) | Winner |
|-----------|-----------|-----------|--------|
| GPQA | 87.6% | Coming soon | Coming soon |
| GPQA-D | 87.6% | Coming soon | Coming soon |
| SuperGPQA | 69.2% | Coming soon | Coming soon |
| MMLU-Pro | 87.1% | Coming soon | Coming soon |
| MMLU-Pro (Arcee) | 87.1% | Coming soon | Coming soon |
| HLE | 30.1% | Coming soon | Coming soon |

### Multilingual

- Winner: Insufficient shared evidence
- Kimi K2.5 public-lane score: 87.3 (#8/16)
- BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) public-lane score: Coming soon

| Benchmark | Kimi K2.5 | BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) | Winner |
|-----------|-----------|-----------|--------|
| MMLU-ProX | 82.3% | Coming soon | Coming soon |
| NOVA-63 | 56.0% | Coming soon | Coming soon |

### Instruction Following

- Winner: Insufficient shared evidence
- Kimi K2.5 public-lane score: 84.4 (#41/124)
- BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) public-lane score: Coming soon

| Benchmark | Kimi K2.5 | BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) | Winner |
|-----------|-----------|-----------|--------|
| IFEval | 93.9% | Coming soon | Coming soon |

### Mathematics

- Winner: Insufficient shared evidence
- Kimi K2.5 public-lane score: 62.1 (#4/7)
- BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) public-lane score: Coming soon

| Benchmark | Kimi K2.5 | BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) | Winner |
|-----------|-----------|-----------|--------|
| AIME 2025 | 96.1% | Coming soon | Coming soon |
| AIME26 | 95.8% | Coming soon | Coming soon |
| AIME25 (Arcee) | 96.3% | Coming soon | Coming soon |
| HMMT Feb 2025 | 95.4% | Coming soon | Coming soon |
| HMMT Nov 2025 | 91.1% | Coming soon | Coming soon |
| HMMT Feb 2026 | 87.1% | Coming soon | Coming soon |
| MMAnswerBench | 81.8% | Coming soon | Coming soon |
| FrontierMath v2 (Tiers 1-3) | 27.900% | Coming soon | Coming soon |
| FrontierMath v2 (Tier 4) | 4.200% | Coming soon | Coming soon |

## FAQ

### Can I compare Kimi K2.5 and BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) on BenchLM yet?

Not fully yet. BenchLM is tracking both models, but sourced benchmark coverage is still incomplete for a fair score-level comparison.

### Why does this page show "coming soon" values?

BenchLM only calls winners when public benchmark coverage is available on both sides of the comparison.

## Related Comparisons

- [Kimi K2.5 vs Kimi K2.5 (Reasoning)](/compare/kimi-k2-5-vs-kimi-k2-5-reasoning)
- [BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) vs Kimi K2.5 (Reasoning)](/compare/kimi-k2-5-reasoning-vs-native-contractnli-bert-base-fine-tuned-on-case-law-and-contract-corpora-chalkidis-et-al-2020)
- [Kimi K2.5 vs GPT-6 Astra](/compare/gpt-6-astra-vs-kimi-k2-5)
- [BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) vs GPT-6 Astra](/compare/gpt-6-astra-vs-native-contractnli-bert-base-fine-tuned-on-case-law-and-contract-corpora-chalkidis-et-al-2020)

## Explore More

- [Kimi K2.5 profile](/models/kimi-k2-5)
- [BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) profile](/models/native-contractnli-bert-base-fine-tuned-on-case-law-and-contract-corpora-chalkidis-et-al-2020)
- [Compare Pricing](/llm-pricing)
- [Alternative Finder](/tools/alternative-finder)
- [LLM Selector](/tools/llm-selector)
- [Overall Rankings](/best/overall)