Benchmark profile
Toolathlon Verified Pass cubed (Toolathlon Verified Pass³)
Fraction of Toolathlon Verified tasks solved in all three independent trials.
Data verifiedBenchmark score on Toolathlon Verified Pass³ — July 24, 2026
BenchLM mirrors the published score view for Toolathlon Verified Pass³. Claude Opus 5 leads the public snapshot at 73.1%. BenchLM does not use these results to rank models overall.
Benchmark score table (1 model)
ScoreAbout Toolathlon Verified Pass³
Year
2026
Tasks
108 verified real-world tool-use tasks
Format
All-three-trials pass rate
Difficulty
Long-horizon application tool use
Table 8.13.6.A reports this reliability metric separately from Pass@1 and Pass@3.
BenchLM freshness & provenance
Version
Toolathlon Verified Pass³ 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
FAQ
What does Toolathlon Verified Pass³ measure?
Fraction of Toolathlon Verified tasks solved in all three independent trials.
Which model scores highest on Toolathlon Verified Pass³?
Claude Opus 5 by Anthropic currently leads with a score of 73.1% on Toolathlon Verified Pass³.
How many models are evaluated on Toolathlon Verified Pass³?
1 AI models have been evaluated on Toolathlon Verified Pass³ on BenchLM.