# Claude Opus 5 vs BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI)

> Side-by-side benchmark comparison for Claude Opus 5 and BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) across agentic, coding, multimodal, knowledge, reasoning, multilingual, and math tasks.

- Canonical page: https://benchlm.ai/compare/claude-opus-5-vs-native-contractnli-bert-base-fine-tuned-on-case-law-and-contract-corpora-chalkidis-et-al-2020
- Last updated: October 1, 2026

- Shared sourced benchmarks: 0
- HTML indexing: indexable
- Ranking lane: BenchAlign v5.8

## Quick Verdict

No benchmark verdict yet: there is no shared sourced benchmark row for Claude Opus 5 and BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI).

## Summary

- Claude Opus 5 and BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) do not currently share a sourced benchmark row. The mirror therefore compares metadata, pricing, context windows, and each model's separately reported coverage without naming a benchmark winner.

## Model Snapshot

| Property | Claude Opus 5 | BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) |
|----------|----------|----------|
| Creator | Anthropic | Koreeda and Manning |
| Type | Proprietary | Research system |
| Reasoning | Reasoning | Unspecified |
| Context | null | null |
| Independent public score (not head-to-head) | 79.89 | null |
| Benchmarks Covered | 77 | 0 |
| Pricing (input/output) | $5.00 / $25.00 | Pricing unavailable / Pricing unavailable |

## Category Breakdown

### Agentic

- Winner: Insufficient shared evidence
- Claude Opus 5 public-lane score: 77.6 (Supported · #3/119)
- BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) public-lane score: Coming soon

| Benchmark | Claude Opus 5 | BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) | Winner |
|-----------|-----------|-----------|--------|
| Terminal-Bench 3.0 | 42.7% | Coming soon | Coming soon |
| BrowseComp | 90.8% | Coming soon | Coming soon |
| HLE w/ tools | 64.7% | Coming soon | Coming soon |
| DeepSearchQA | 95.0% | Coming soon | Coming soon |
| DRACO | 88.6% | Coming soon | Coming soon |
| BrowseComp (10-agent, prerelease) | 93.6% | Coming soon | Coming soon |
| OSWorld 2.0 | 70.6% | Coming soon | Coming soon |
| MCP Atlas | 85.8% | Coming soon | Coming soon |
| MCP-Atlas claim coverage | 89.1% | Coming soon | Coming soon |
| LAB all-pass (Anthropic harness) | 23.58% | Coming soon | Coming soon |
| LAB criterion-pass (Anthropic harness) | 93.74% | Coming soon | Coming soon |
| LAB all-pass (Harvey held-out) | 11.7% | Coming soon | Coming soon |
| LAB criterion-pass (Harvey held-out) | 94.1% | Coming soon | Coming soon |
| Toolathlon-Verified | 80.6% | Coming soon | Coming soon |
| Toolathlon Verified Pass@3 | 87.0% | Coming soon | Coming soon |
| Toolathlon Verified Pass³ | 73.1% | Coming soon | Coming soon |
| Toolathlon Verified avg. turns | 23.5 turns | Coming soon | Coming soon |
| AutomationBench | 26.0% | Coming soon | Coming soon |
| Terminal-Bench 2.1 (Vals) | 84.6% | Coming soon | Coming soon |
| ApprenticeBench | 36% | Coming soon | Coming soon |

### Coding

- Winner: Insufficient shared evidence
- Claude Opus 5 public-lane score: 72.1 (Supported · #7/144)
- BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) public-lane score: Coming soon

| Benchmark | Claude Opus 5 | BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) | Winner |
|-----------|-----------|-----------|--------|
| Bug Hunt Bench | 27 fixes | Coming soon | Coming soon |
| SWE-bench Verified | 96% | Coming soon | Coming soon |
| SWE-bench Pro | 79.2% | Coming soon | Coming soon |
| SWE Multilingual | 89.5% | Coming soon | Coming soon |
| SWE Multimodal | 59.4% | Coming soon | Coming soon |
| DeepSWE | 68.8% | Coming soon | Coming soon |
| FrontierCode 1.1 Main | 53.4% | Coming soon | Coming soon |
| FrontierCode 1.1 Extended | 63.6% | Coming soon | Coming soon |
| FrontierSWE v2 | 52.0% | Coming soon | Coming soon |
| ProgramBench (episode 1) | 83.0% | Coming soon | Coming soon |
| ProgramBench | 93.0% | Coming soon | Coming soon |
| CursorBench 3.2 | 70.0% | Coming soon | Coming soon |
| VulcanBench v3 | 87.0% | Coming soon | Coming soon |
| VulcanBench CII v1 | 96.4% | Coming soon | Coming soon |
| LiveCodeBench (Vals) | 89.0% | Coming soon | Coming soon |
| SWE-bench (Vals) | 97.0% | Coming soon | Coming soon |
| CursorBench 4.0 | 46.6% | Coming soon | Coming soon |
| PostTrainBench v1.1 | 35.0% | Coming soon | Coming soon |

### Reasoning

- Winner: Insufficient shared evidence
- Claude Opus 5 public-lane score: 77.3 (#10/27)
- BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) public-lane score: Coming soon

| Benchmark | Claude Opus 5 | BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) | Winner |
|-----------|-----------|-----------|--------|
| ARC-AGI-1 | 97.50% | Coming soon | Coming soon |
| ARC-AGI-2 | 90.4% | Coming soon | Coming soon |
| ARC-AGI-3 | 30.2% | Coming soon | Coming soon |

### Multimodal & Grounded

- Winner: Insufficient shared evidence
- Claude Opus 5 public-lane score: 88.8 (#2/49)
- BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) public-lane score: Coming soon

| Benchmark | Claude Opus 5 | BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) | Winner |
|-----------|-----------|-----------|--------|
| Chartography (no tools) | 29.6% | Coming soon | Coming soon |
| Chartography (tools) | 83.0% | Coming soon | Coming soon |
| BenchCAD Vision2Code (no tools) | 0.366 | Coming soon | Coming soon |
| BenchCAD Vision2Code (tools) | 0.821 | Coming soon | Coming soon |
| GDP.pdf (no tools) | 83.4% | Coming soon | Coming soon |
| GDP.pdf (tools) | 85.5% | Coming soon | Coming soon |
| OfficeQA | 78.1% | Coming soon | Coming soon |
| OfficeQA Pro | 66.9% | Coming soon | Coming soon |

### Knowledge

- Winner: Insufficient shared evidence
- Claude Opus 5 public-lane score: 80.2 (Supported · #7/170)
- BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) public-lane score: Coming soon

| Benchmark | Claude Opus 5 | BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) | Winner |
|-----------|-----------|-----------|--------|
| HLE | 64.7% | Coming soon | Coming soon |
| HLE w/o tools | 56.3% | Coming soon | Coming soon |
| HLE-Verified | 54.4% | Coming soon | Coming soon |
| LABBench2 | 84.2% | Coming soon | Coming soon |
| HealthBench (raw) | 67.1% | Coming soon | Coming soon |
| HealthBench (length-adjusted) | 57.8% | Coming soon | Coming soon |
| HealthBench Professional | 59.8% | Coming soon | Coming soon |
| HealthBench Professional (raw) | 73.4% | Coming soon | Coming soon |
| BioMysteryBench (human-solvable) | 90.1% | Coming soon | Coming soon |
| BioMysteryBench (human-difficult) | 49.4% | Coming soon | Coming soon |
| SpatialBench Verified | 72.5% | Coming soon | Coming soon |
| SingleCellBench | 60.6% | Coming soon | Coming soon |
| ProteinGym Hard | 47.7% | Coming soon | Coming soon |
| Protein Design | 42.5% | Coming soon | Coming soon |
| Organic chemistry V2 | 61.6% | Coming soon | Coming soon |
| Protocols (troubleshooting) | 61.1% | Coming soon | Coming soon |
| Protocols (understanding) | 78.4% | Coming soon | Coming soon |
| GPQA Diamond (Vals) | 93.4% | Coming soon | Coming soon |
| MMLU-Pro (Vals) | 91.6% | Coming soon | Coming soon |

### Multilingual

- Winner: Insufficient shared evidence
- Claude Opus 5 public-lane score: Coming soon
- BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) public-lane score: Coming soon

| Benchmark | Claude Opus 5 | BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) | Winner |
|-----------|-----------|-----------|--------|
| GMMLU | 92.5% | Coming soon | Coming soon |
| MILU | 92.1% | Coming soon | Coming soon |
| INCLUDE | 89.8% | Coming soon | Coming soon |

### Instruction Following

- Winner: Insufficient shared evidence
- Claude Opus 5 public-lane score: Coming soon
- BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) public-lane score: Coming soon

| Benchmark | Claude Opus 5 | BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) | Winner |
|-----------|-----------|-----------|--------|
| Gray Swan IPI (15 attempts) | 4.6% | Coming soon | Coming soon |

### Mathematics

- Winner: Insufficient shared evidence
- Claude Opus 5 public-lane score: Coming soon
- BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) public-lane score: Coming soon

| Benchmark | Claude Opus 5 | BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) | Winner |
|-----------|-----------|-----------|--------|
| IMO 2026 | 42/42 | Coming soon | Coming soon |
| RiemannBench (no tools) | 60.0% | Coming soon | Coming soon |
| RiemannBench (tools) | 79.0% | Coming soon | Coming soon |
| ArXivMath Jun. 2026 (no tools) | 90.8% | Coming soon | Coming soon |
| ArXivMath Jun. 2026 (tools) | 91.3% | Coming soon | Coming soon |

## FAQ

### Can I compare Claude Opus 5 and BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) on BenchLM yet?

Not fully yet. BenchLM is tracking both models, but sourced benchmark coverage is still incomplete for a fair score-level comparison.

### Why does this page show "coming soon" values?

BenchLM only calls winners when public benchmark coverage is available on both sides of the comparison.

## Related Comparisons

- [Claude Opus 5 vs GPT-6 Astra](/compare/claude-opus-5-vs-gpt-6-astra)
- [BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) vs GPT-6 Astra](/compare/gpt-6-astra-vs-native-contractnli-bert-base-fine-tuned-on-case-law-and-contract-corpora-chalkidis-et-al-2020)
- [Claude Opus 5 vs Claude Opus 5.5](/compare/claude-opus-5-vs-claude-opus-5-5)
- [BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) vs Claude Opus 5.5](/compare/claude-opus-5-5-vs-native-contractnli-bert-base-fine-tuned-on-case-law-and-contract-corpora-chalkidis-et-al-2020)

## Explore More

- [Claude Opus 5 profile](/models/claude-opus-5)
- [BERT base / Fine-tuned on case law and contract corpora Chalkidis et al. (2020) (ContractNLI) profile](/models/native-contractnli-bert-base-fine-tuned-on-case-law-and-contract-corpora-chalkidis-et-al-2020)
- [Compare Pricing](/llm-pricing)
- [Alternative Finder](/tools/alternative-finder)
- [LLM Selector](/tools/llm-selector)
- [Overall Rankings](/best/overall)