Legal Agent Benchmark all-pass rate — Harvey held-out set (LAB all-pass (Harvey held-out))
We show this table for reference; we do not rank on it.
Harvey AI's strict held-out task success rate requiring every rubric criterion to pass.
Benchmark score on LAB all-pass (Harvey held-out) — November 13, 2026
We compile the LAB all-pass (Harvey held-out) rows from provider self-reports. Claude Opus 5 leads the table at 11.7%, followed by Claude Sonnet 5.5 (10.0%) and Claude Opus 5.5 (8.3%). We do not use these results to rank models overall.
Claude Opus 5
Anthropic
Reported by AnthropicClaude Sonnet 5.5
Anthropic
Reported by AnthropicClaude Opus 5.5
Anthropic
Reported by Anthropic3 modelsAgenticCurrentDisplay onlyUpdated November 13, 2026
Benchmark score table (3 models)
All 3 results on this page were reported by the labs that built the models.
| Rank | Model / configuration | Score | Who ran it | Parameters (B) | Open / closed |
|---|---|---|---|---|---|
| 1 | Claude Opus 5AnthropicReported by Anthropic | 11.7% | Reported by Anthropic | Not reported | Closed |
| 2 | Claude Sonnet 5.5AnthropicReported by Anthropic | 10.0% | Reported by Anthropic | Not reported | Closed |
| 3 | Claude Opus 5.5AnthropicReported by Anthropic | 8.3% | Reported by Anthropic | Not reported | Closed |
- Lab-reported
- Benchmark-run
- Independent
Among the reported LAB all-pass (Harvey held-out) rows, Claude Opus 5 is first at 11.7%. The third row is 3.4 points behind. The broader top-10 range is 3.4 points, so many of the published results sit in a relatively narrow band.
3 models have been evaluated on LAB all-pass (Harvey held-out). The benchmark falls in the Agentic category. LAB all-pass (Harvey held-out) is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.
About LAB all-pass (Harvey held-out)
Year
2026
Tasks
Harvey-held-out legal-agent tasks
Format
All-criteria pass rate
Difficulty
Professional legal work
Section 8.13.3 separately reports Harvey's evaluation on its held-out set. It is not merged with Anthropic's internal-harness result.
Freshness and provenance
Version
LAB all-pass (Harvey held-out) 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
Questions
What does LAB all-pass (Harvey held-out) measure?
Harvey AI's strict held-out task success rate requiring every rubric criterion to pass.
Which model scores highest on LAB all-pass (Harvey held-out)?
Claude Opus 5 by Anthropic currently leads with a score of 11.7% on LAB all-pass (Harvey held-out).
How many models are evaluated on LAB all-pass (Harvey held-out)?
3 AI models have published results on LAB all-pass (Harvey held-out) in the BenchLM catalog.
Compare top models on LAB all-pass (Harvey held-out)
Know when it’s worth switching models
The model to choose, the cheaper alternative, and the release we would wait on.
Read a sample issueJoin 7,000+ subscribers.
One email each week. Unsubscribe anytime.