# Kimi K3.1 Pro vs BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI)

> Side-by-side benchmark comparison for Kimi K3.1 Pro and BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) across agentic, coding, multimodal, knowledge, reasoning, multilingual, and math tasks.

- Canonical page: https://benchlm.ai/compare/kimi-3-1-pro-vs-native-contractnli-bert-base-fine-tuned-on-case-law-and-contract-corpora-chalkidis-et-al-2020
- Last updated: October 23, 2026

- Shared sourced benchmarks: 0
- HTML indexing: indexable
- Ranking lane: BenchAlign v5.8

## Quick Verdict

No benchmark verdict yet: there is no shared sourced benchmark row for Kimi K3.1 Pro and BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI).

## Summary

- Kimi K3.1 Pro and BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) do not currently share a sourced benchmark row. The mirror therefore compares metadata, pricing, context windows, and each model's separately reported coverage without naming a benchmark winner.

## Model Snapshot

| Property | Kimi K3.1 Pro | BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) |
|----------|----------|----------|
| Creator | Moonshot AI | Koreeda and Manning |
| Type | Pending | Research system |
| Reasoning | Reasoning | Unspecified |
| Context | 1.05M | null |
| Independent public score (not head-to-head) | null | null |
| Benchmarks Covered | 42 | 0 |
| Pricing (input/output) | $2.00 / $10.00 | Pricing unavailable / Pricing unavailable |

## Category Breakdown

### Agentic

- Winner: Insufficient shared evidence
- Kimi K3.1 Pro public-lane score: Coming soon
- BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) public-lane score: Coming soon

| Benchmark | Kimi K3.1 Pro | BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) | Winner |
|-----------|-----------|-----------|--------|
| Terminal-Bench 4.0 | 65.70% | Coming soon | Coming soon |
| Terminal-Bench-Science 0.1 | 38.1% | Coming soon | Coming soon |
| HLE w/ tools | 70.0% | Coming soon | Coming soon |
| BrowseComp | 92.1% | Coming soon | Coming soon |
| BioMysteryBench | 80.6% | Coming soon | Coming soon |
| Agents' Last Exam | 43.2% | Coming soon | Coming soon |
| Agents' Last Exam (CLI) | 44.2% | Coming soon | Coming soon |
| APEX-Agents | 67.2% | Coming soon | Coming soon |
| Frontier Finance | 58.6% | Coming soon | Coming soon |
| HANDBOOK.md | 44.6% | Coming soon | Coming soon |
| OSWorld 2.0 | 79.6% | Coming soon | Coming soon |
| Business Operation | 37.8% | Coming soon | Coming soon |
| Financial Modeling | 57.6% | Coming soon | Coming soon |
| Financial Research | 70.4% | Coming soon | Coming soon |
| Kimi Hallu Bench Hard (tools) | 8.3% | Coming soon | Coming soon |
| ExploitGym | 20.7% | Coming soon | Coming soon |

### Coding

- Winner: Insufficient shared evidence
- Kimi K3.1 Pro public-lane score: Coming soon
- BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) public-lane score: Coming soon

| Benchmark | Kimi K3.1 Pro | BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) | Winner |
|-----------|-----------|-----------|--------|
| DeepSWE | 75.5% | Coming soon | Coming soon |
| ProgramBench (binary) | 31.5% | Coming soon | Coming soon |
| Kimi Code Bench v2 | 77.1% | Coming soon | Coming soon |
| Kimi Code Bench 3.0 Long-horizon | 61.2% | Coming soon | Coming soon |
| sweMarathon | 51.7% | Coming soon | Coming soon |
| PostTrainBench v1.2 | 36.5% | Coming soon | Coming soon |

### Multimodal & Grounded

- Winner: Insufficient shared evidence
- Kimi K3.1 Pro public-lane score: 98 (#1/56)
- BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) public-lane score: Coming soon

| Benchmark | Kimi K3.1 Pro | BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) | Winner |
|-----------|-----------|-----------|--------|
| OfficeQA Pro | 67.4% | Coming soon | Coming soon |
| OfficeQA Pro v2 | 64.4% | Coming soon | Coming soon |
| BenchCAD Vision2Code (no tools) | 0.728 | Coming soon | Coming soon |
| BenchCAD Vision2Code (tools) | 0.927 | Coming soon | Coming soon |
| MMMU-Pro | 84.1% | Coming soon | Coming soon |
| MMMU-Pro w/ Python | 90% | Coming soon | Coming soon |
| CharXiv | 93.4% | Coming soon | Coming soon |
| CharXiv w/o tools | 89% | Coming soon | Coming soon |
| Chartography (tools) | 90.2% | Coming soon | Coming soon |
| BabyVision w/ Python | 95.4% | Coming soon | Coming soon |
| ZeroBench | 39.0% | Coming soon | Coming soon |
| ZeroBench w/ Python | 63.0% | Coming soon | Coming soon |
| GDP.pdf (Gemini judge) | 34.6% | Coming soon | Coming soon |
| GDP.pdf w/ Python (Gemini judge) | 85.7% | Coming soon | Coming soon |
| PerceptionBench | 68.3% | Coming soon | Coming soon |

### Knowledge

- Winner: Insufficient shared evidence
- Kimi K3.1 Pro public-lane score: Coming soon
- BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) public-lane score: Coming soon

| Benchmark | Kimi K3.1 Pro | BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) | Winner |
|-----------|-----------|-----------|--------|
| GPQA | 94.2% | Coming soon | Coming soon |
| GPQA-D | 94.2% | Coming soon | Coming soon |
| HLE | 70% | Coming soon | Coming soon |
| HLE w/o tools | 51.1% | Coming soon | Coming soon |
| Kimi Hallu Bench | 5.4% | Coming soon | Coming soon |

## FAQ

### Can I compare Kimi K3.1 Pro and BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) on BenchLM yet?

Not fully yet. BenchLM is tracking both models, but sourced benchmark coverage is still incomplete for a fair score-level comparison.

### Why does this page show "coming soon" values?

BenchLM only calls winners when public benchmark coverage is available on both sides of the comparison.

## Related Comparisons

- [Kimi K3.1 Pro vs Claude Opus 5.5](/compare/claude-opus-5-5-vs-kimi-3-1-pro)
- [BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) vs Claude Opus 5.5](/compare/claude-opus-5-5-vs-native-contractnli-bert-base-fine-tuned-on-case-law-and-contract-corpora-chalkidis-et-al-2020)
- [Kimi K3.1 Pro vs GPT-6.1 Sol](/compare/gpt-6-1-sol-vs-kimi-3-1-pro)
- [BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) vs GPT-6.1 Sol](/compare/gpt-6-1-sol-vs-native-contractnli-bert-base-fine-tuned-on-case-law-and-contract-corpora-chalkidis-et-al-2020)

## Explore More

- [Kimi K3.1 Pro profile](/models/kimi-3-1-pro)
- [BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) profile](/models/native-contractnli-bert-base-fine-tuned-on-case-law-and-contract-corpora-chalkidis-et-al-2020)
- [Compare Pricing](/llm-pricing)
- [Alternative Finder](/tools/alternative-finder)
- [LLM Selector](/tools/llm-selector)
- [Overall Rankings](/best/overall)