Benchmark profile

Humanity's Last Exam with tools (HLE w/ tools)

Tool-augmented Humanity's Last Exam scores reported in DeepSeek-V4 thinking-mode evaluations.

Data verified July 29, 2026

Benchmark score on HLE w/ tools — July 29, 2026

BenchLM mirrors the published score view for HLE w/ tools. Claude Opus 5 leads the public snapshot at 64.7% , followed by Claude Sonnet 5 (57.4%) and Qwen3.7 Max (53.5%). BenchLM does not use these results to rank models overall.

1Closed

Claude Opus 5

Anthropic

claude-opus-5

64.7%

Overall 82.81

2Closed

Claude Sonnet 5

Anthropic

claude-sonnet-5

57.4%

Overall 64.55Context 1M

3Closed

Qwen3.7 Max

Alibaba

qwen3-7-max

53.5%

Overall 71.81Context 1M

10 modelsAgenticCurrentDisplay onlyUpdated July 29, 2026

Benchmark score table (10 models)

Score

Claude Opus 5Anthropic · Closed

64.7%

Claude Sonnet 5Anthropic · Closed

57.4%

Qwen3.7 MaxAlibaba · Closed

53.5%

DeepSeek V4 Pro (Max)DeepSeek · Open weight

48.2%

Agents-A1InternScience · Open weight

47.6%

Step 3.7 FlashStepFun · Open weight

47.2%

DeepSeek V4 Flash (Max)DeepSeek · Open weight

45.1%

DeepSeek V4 Pro (High)DeepSeek · Open weight

44.7%

DeepSeek V4 Flash (High)DeepSeek · Open weight

40.3%

Nemotron 3 UltraNVIDIA · Open weight

37.4%

The published HLE w/ tools snapshot places Claude Opus 5 first at 64.7%. The third row is 11.2 points behind. The broader top-10 range is 27.3 points, so the table still separates the published systems.

10 models have been evaluated on HLE w/ tools. The benchmark falls in the Agentic category. This category carries a 22% weight in BenchLM.ai's overall scoring system. HLE w/ tools is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.

About HLE w/ tools

Year

2026

Tasks

Expert questions with tool use

Format

Pass@1

Difficulty

Frontier tool-augmented reasoning

BenchLM stores HLE w/ tools as a display-only provider-table row when exact values are published in DeepSeek-V4 evaluations.

DeepSeek-V4 Technical Report

BenchLM freshness & provenance

Version

HLE w/ tools 2026

Refresh cadence

Quarterly

Staleness state

Current

Question availability

Public benchmark set

CurrentDisplay only

BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.

FAQ

What does HLE w/ tools measure?

Tool-augmented Humanity's Last Exam scores reported in DeepSeek-V4 thinking-mode evaluations.

Which model scores highest on HLE w/ tools?

Claude Opus 5 by Anthropic currently leads with a score of 64.7% on HLE w/ tools.

How many models are evaluated on HLE w/ tools?

10 AI models have been evaluated on HLE w/ tools on BenchLM.

Compare Top Models on HLE w/ tools

Claude Opus 5 vs Claude Sonnet 5 Claude Sonnet 5 vs Qwen3.7 Max Qwen3.7 Max vs DeepSeek V4 Pro (Max)DeepSeek V4 Pro (Max) vs Agents-A1

Last updated: July 29, 2026 · BenchLM version HLE w/ tools 2026

Know when it’s worth switching models

The model to choose, the cheaper alternative, and the release we would wait on.

Read a sample issue

Join 2,000+ readers.

One email each week. Unsubscribe anytime.