Scale Labs Humanity's Last Exam (Text Only)
We show this table for reference; we do not rank on it.
A Scale Labs public leaderboard mirrored as display-only reference data. It does not affect BenchLM rankings.
Scale score on Humanity's Last Exam (Text Only) — October 15, 2026 snapshot
We mirror the published scale score view for Humanity's Last Exam (Text Only). GPT-6 Astra leads the public snapshot at 54.2%, followed by gemini-3.1-pro-preview (thinking high) (47.3%) and Fable 5.1 (xhigh) (46.8%). We do not use these results to rank models overall.
GPT-6 Astra
OpenAI
gemini-3.1-pro-preview (thinking high)
Fable 5.1 (xhigh)
Anthropic
65 modelsKnowledgeCurrentDisplay onlyUpdated October 15, 2026 snapshot
Scale score table (65 models)
| Rank | Model / configuration | Score | Parameters (B) | Open / closed |
|---|---|---|---|---|
| 1 | GPT-6 AstraOpenAI | 54.2% | Not reported | Closed |
| 2 | gemini-3.1-pro-preview (thinking high)Google | 47.3% | Not reported | Unknown |
| 3 | Fable 5.1 (xhigh)Anthropic | 46.8% | Not reported | Unknown |
| 4 | Sonnet 5.5 (xhigh)Anthropic | 46.6% | Not reported | Unknown |
| 5 | GPT-5.4 ProOpenAI | 45.3% | Not reported | Closed |
| 6 | Gemini 3.8 FlashGoogle | 45.0% | Not reported | Closed |
| 7 | Muse SparkMeta | 40.9% | Not reported | Closed |
| 8 | gemini-3-pro-previewGoogle | 37.7% | Not reported | Unknown |
| 9 | gpt-5.4-2026-03-05 (xhigh thinking)OpenAI | 36.5% | Not reported | Unknown |
| 10 | claude-opus-4-6-thinking-maxAnthropic | 36.2% | Not reported | Unknown |
| 11 | gpt-5-pro-2025-10-06OpenAI | 33.3% | Not reported | Unknown |
| 12 | Claude Haiku 5.5Anthropic | 30.4% | Not reported | Closed |
| 13 | GPT-5.2OpenAI | 28.5% | Not reported | Closed |
| 14 | Claude Opus 4.5 ThinkingAnthropic | 26.3% | Not reported | Closed |
| 15 | gpt-5-2025-08-07OpenAI | 26.3% | Not reported | Unknown |
| 16 | gpt-5.1-thinkingOpenAI | 24.6% | Not reported | Unknown |
| 17 | gemini-2.5-pro-preview-06-05Google | 22.1% | Not reported | Unknown |
| 18 | o3 (high) (April 2025)OpenAI | 20.6% | Not reported | Unknown |
| 19 | o3 (medium) (April 2025)OpenAI | 19.8% | Not reported | Unknown |
| 20 | GPT-5 miniOpenAI | 19.7% | Not reported | Closed |
| 21 | claude-opus-4-6 (Non-Thinking)Anthropic | 19.4% | Not reported | Unknown |
| 22 | o4-mini (high) (April 2025)OpenAI | 18.9% | Not reported | Unknown |
| 23 | Gemini 2.5 Pro Experimental (March 2025)Google | 18.4% | Not reported | Unknown |
| 24 | Gemini 2.5 Pro Preview (May 06 2025)Google | 18.4% | Not reported | Unknown |
| 25 | GPT-OSS 120BOpenAI | 15.5% | Not reported | Open |
| 26 | Qwen3-235B-A22B-Thinking-2507Alibaba | 15.4% | Not reported | Unknown |
| 27 | o4-mini (medium) (April 2025)OpenAI | 14.5% | Not reported | Unknown |
| 28 | Claude Sonnet 4.5 ThinkingAnthropic | 14.1% | Not reported | Closed |
| 29 | DeepSeek-R1-0528DeepSeek | 14.0% | Not reported | Open |
| 30 | Claude Opus 4.5Anthropic | 13.9% | Not reported | Closed |
| 31 | o3 mini (high)OpenAI | 13.4% | Not reported | Unknown |
| 32 | DeepSeek V3.1DeepSeek | 12.9% | Not reported | Open |
| 33 | Gemini 2.5 Flash (April 2025)Google | 12.6% | Not reported | Unknown |
| 34 | Qwen3 235B-A22BAlibaba | 11.8% | Not reported | Open |
| 35 | claude-opus-4-1-20250805-thinkingAnthropic | 11.3% | Not reported | Unknown |
| 36 | Claude Opus 4 (Thinking)Anthropic | 10.8% | Not reported | Unknown |
| 37 | Gemini 2.5 Flash Preview (May 2025)Google | 10.7% | Not reported | Unknown |
| 38 | o3 mini (medium)OpenAI | 10.3% | Not reported | Unknown |
| 39 | GPT-OSS 20BOpenAI | 9.7% | Not reported | Open |
| 40 | glm-4p5Z.AI | 9.6% | Not reported | Unknown |
| 41 | glm-4p5-airZ.AI | 9.4% | Not reported | Unknown |
| 42 | DeepSeek-R1DeepSeek | 8.5% | Not reported | Open |
| 43 | gemini-3.1-flash-lite-previewGoogle | 8.0% | Not reported | Unknown |
| 44 | Claude 3.7 Sonnet (Thinking)Anthropic | 7.9% | Not reported | Unknown |
| 45 | o1 (December 2024)OpenAI | 7.8% | Not reported | Unknown |
| 46 | o1-proOpenAI | 7.7% | Not reported | Closed |
| 47 | Claude Sonnet 4.5Anthropic | 7.7% | Not reported | Closed |
| 48 | Claude Sonnet 4 (Thinking)\nAnthropic | 7.6% | Not reported | Unknown |
| 49 | claude-opus-4-1-20250805Anthropic | 7.4% | Not reported | Unknown |
| 50 | Gemini 2.0 Flash Thinking (January 2025)Google | 6.5% | Not reported | Unknown |
| 51 | gpt-5.1-instantOpenAI | 6.5% | Not reported | Unknown |
| 52 | Claude Opus 4 \nAnthropic | 6.3% | Not reported | Unknown |
| 53 | GPT 4.5 PreviewOpenAI | 5.8% | Not reported | Unknown |
| 54 | Claude Sonnet 4Anthropic | 5.4% | Not reported | Unknown |
| 55 | Llama 4 MaverickMeta | 5.3% | Not reported | Open |
| 56 | GPT-4.1OpenAI | 5.0% | Not reported | Closed |
| 57 | kimi-k2-instructMoonshot AI | 4.7% | Not reported | Unknown |
| 58 | DeepSeek V3 (March 2025)Deepseek | 4.5% | Not reported | Unknown |
| 59 | Gemini-1.5-Pro-002Google | 4.5% | Not reported | Unknown |
| 60 | Nova MicroAmazon | 4.4% | Not reported | Unknown |
| 61 | Mistral Medium 3Mistral | 4.4% | Not reported | Closed |
| 62 | Claude 3.5 Sonnet (October 2024)Anthropic | 4.3% | Not reported | Unknown |
| 63 | Nova ProAmazon | 4.3% | Not reported | Closed |
| 64 | Nova LiteAmazon | 3.8% | Not reported | Unknown |
| 65 | GPT-4o (November 2024)OpenAI | 2.3% | Not reported | Unknown |
How to read this leaderboard
Compare the published configurations as complete evaluation systems. The source can combine a base model, agent scaffold, tools, budget, and inference setting in each result.
Operator receipt: 65 sourced rows are currently displayable on this page; the leading published row is GPT-6 Astra at 54.2%.
Honest limit: This Scale table is display-only context, not benchmark provenance or a weighted model-only comparison.
How BenchLM shows Humanity's Last Exam (Text Only)
BenchLM mirrors 65 published rows from Scale Labs’ public Humanity's Last Exam (Text Only) leaderboard, captured on October 15, 2026 snapshot.
The table is display only. It is useful context for a published agent or model configuration, but it does not enter BenchLM’s overall or category rankings.
Snapshot
The published Humanity's Last Exam (Text Only) snapshot places GPT-6 Astra first at 54.2%. The third row is 7.4 points behind. The broader top-10 range is 17.9 points, so the table still separates the published systems.
65 models have been evaluated on Humanity's Last Exam (Text Only). The benchmark falls in the Knowledge category. We keep external benchmark mirrors separate from the weighted global scoring system, so these results remain source-specific evidence. Humanity's Last Exam (Text Only) is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.
About Humanity's Last Exam (Text Only)
Year
2026
Tasks
65 published rows
Format
Published Scale leaderboard score
Difficulty
External agent and model evaluation
BenchLM mirrors 65 published rows from the Humanity's Last Exam (Text Only) public table captured on October 15, 2026 snapshot.
Freshness and provenance
Version
Humanity's Last Exam (Text Only) 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
Questions
What does Humanity's Last Exam (Text Only) measure?
A Scale Labs public leaderboard mirrored as display-only reference data. It does not affect BenchLM rankings.
Which model leads the published Humanity's Last Exam (Text Only) snapshot?
GPT-6 Astra currently leads the published Humanity's Last Exam (Text Only) snapshot with 54.2% scale score. BenchLM shows this benchmark for display only and does not use it in overall rankings.
How many models are evaluated on Humanity's Last Exam (Text Only)?
The October 15, 2026 snapshot snapshot contains 65 AI models.
Know when it’s worth switching models
The model to choose, the cheaper alternative, and the release we would wait on.
Read a sample issueJoin 5,600+ readers.
One email each week. Unsubscribe anytime.