Benchmark profile
Legal Agent Benchmark all-pass rate — Harvey held-out set (LAB all-pass (Harvey held-out))
Harvey AI's strict held-out task success rate requiring every rubric criterion to pass.
Data verifiedBenchmark score on LAB all-pass (Harvey held-out) — July 24, 2026
BenchLM mirrors the published score view for LAB all-pass (Harvey held-out). Claude Opus 5 leads the public snapshot at 11.7%. BenchLM does not use these results to rank models overall.
Benchmark score table (1 model)
ScoreAbout LAB all-pass (Harvey held-out)
Year
2026
Tasks
Harvey-held-out legal-agent tasks
Format
All-criteria pass rate
Difficulty
Professional legal work
Section 8.13.3 separately reports Harvey's evaluation on its held-out set. It is not merged with Anthropic's internal-harness result.
BenchLM freshness & provenance
Version
LAB all-pass (Harvey held-out) 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
FAQ
What does LAB all-pass (Harvey held-out) measure?
Harvey AI's strict held-out task success rate requiring every rubric criterion to pass.
Which model scores highest on LAB all-pass (Harvey held-out)?
Claude Opus 5 by Anthropic currently leads with a score of 11.7% on LAB all-pass (Harvey held-out).
How many models are evaluated on LAB all-pass (Harvey held-out)?
1 AI models have been evaluated on LAB all-pass (Harvey held-out) on BenchLM.