Tool-free variant of Humanity's Last Exam that isolates a model's raw frontier reasoning.
BenchLM mirrors the published score view for HLE w/o tools. Claude Mythos 5 leads the public snapshot at 59% , followed by Claude Fable 5 (59%) and Claude Opus 4.8 (49.8%). BenchLM does not use these results to rank models overall.
Claude Mythos 5
Anthropic
Claude Fable 5
Anthropic
Claude Opus 4.8
Anthropic
The published HLE w/o tools snapshot is tightly clustered at the top: Claude Mythos 5 sits at 59%, while the third row is only 9.2 points behind. The broader top-10 spread is 19.0 points, so the benchmark still separates strong models even when the leaders cluster.
19 models have been evaluated on HLE w/o tools. The benchmark falls in the Knowledge category. This category carries a 12% weight in BenchLM.ai's overall scoring system. HLE w/o tools is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.
Year
2026
Tasks
Expert-level questions
Format
Tool-free expert QA
Difficulty
Frontier expert level
This variant removes external tools so the score reflects pure model performance on frontier expert questions.
Version
HLE w/o tools 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
Tool-free variant of Humanity's Last Exam that isolates a model's raw frontier reasoning.
Claude Mythos 5 by Anthropic currently leads with a score of 59% on HLE w/o tools.
19 AI models have been evaluated on HLE w/o tools on BenchLM.
For engineers, researchers, and the plain curious — a weekly brief on new models, ranking shifts, and pricing changes.
Free. No spam. Unsubscribe anytime.