GPQA Diamond (GPQA-D)
We show this table for reference; we do not rank on it.
A display-only GPQA Diamond reference from provider comparison charts.
Benchmark score on GPQA-D — November 15, 2026
We compile the GPQA-D rows from provider self-reports and secondary reports. GPT-6 Astra leads the table at 96.0%, followed by Sakana Fugu-Ultra (95.5%) and Sakana Fugu (95.5%). We do not use these results to rank models overall.
GPT-6 Astra
OpenAI
Reported by OpenAISakana Fugu-Ultra
Sakana AI
Reported by Sakana AISakana Fugu
Sakana AI
Reported by Sakana AI88 modelsKnowledgeStaleDisplay onlyUpdated November 15, 2026
Benchmark score table (88 models)
None of the 88 results on this page has a documented run by the benchmark or an independent evaluator: 81 reported by the labs that built the models and 7 reported in another publisher’s document.
| Rank | Model / configuration | Score | Who ran it | Parameters (B) | Open / closed |
|---|---|---|---|---|---|
| 1 | GPT-6 AstraOpenAIReported by OpenAI | 96.0% | Reported by OpenAI | Not reported | Closed |
| 2 | Sakana Fugu-UltraSakana AIReported by Sakana AI | 95.5% | Reported by Sakana AI | Not reported | Closed |
| 3 | Sakana FuguSakana AIReported by Sakana AI | 95.5% | Reported by Sakana AI | Not reported | Closed |
| 4 | GPT-5.6 SolOpenAIReported by OpenAI | 94.6% | Reported by OpenAI | Not reported | Closed |
| 5 | Gemini 3.1 ProGoogleReported by Meta AI (comparison table) | 94.3% | Reported by Meta AI (comparison table) | Not reported | Closed |
| 6 | Claude Opus 4.7 (Adaptive)AnthropicReported by Anthropic | 94.2% | Reported by Anthropic | Not reported | Closed |
| 7 | Kimi K3.1 ProMoonshot AIReported by Moonshot AI | 94.2% | Reported by Moonshot AI | Not reported | Open |
| 8 | Claude Opus 4.8AnthropicReported by Anthropic | 93.6% | Reported by Anthropic | Not reported | Closed |
| 9 | GPT-5.5OpenAIReported by OpenAI | 93.6% | Reported by OpenAI | Not reported | Closed |
| 10 | Kimi K3Moonshot AIReported by Moonshot AI | 93.5% | Reported by Moonshot AI | Not reported | Open |
| 11 | Step 5 PreviewStepFunReported by StepFun | 93.5% | Reported by StepFun | Not reported | Open |
| 12 | Inkling 2 SmallThinking Machines LabReported by Thinking Machines Lab | 93.0% | Reported by Thinking Machines Lab | Not reported | Closed |
| 13 | GPT-5.6 TerraOpenAIReported by OpenAI | 92.9% | Reported by OpenAI | Not reported | Closed |
| 14 | GPT-5.4OpenAIReported by Meta AI (comparison table) | 92.8% | Reported by Meta AI (comparison table) | Not reported | Closed |
| 15 | Ornith-1.5-397BOrnith AIReported by Ornith AI | 92.8% | Reported by Ornith AI | Not reported | Open |
| 16 | Gemini 3.5 FlashGoogleReported by a third party | 92.7% | Reported by a third party | Not reported | Closed |
| 17 | Qwen3.8 MaxAlibabaReported by Alibaba | 92.6% | Reported by Alibaba | Not reported | Open |
| 18 | Qwen3.7 MaxAlibabaReported by Alibaba | 92.4% | Reported by Alibaba | Not reported | Closed |
| 19 | Pareto 26.10 PreviewUnbiasedReported by Unbiased | 92.4% | Reported by Unbiased | Not reported | Closed |
| 20 | GPT-5.6 LunaOpenAIReported by OpenAI | 92.3% | Reported by OpenAI | Not reported | Closed |
| 21 | Hy4 previewTencentReported by Tencent | 92.3% | Reported by Tencent | Not reported | Open |
| 22 | Qwen3.8-Flash-NextAlibabaReported by Alibaba | 91.7% | Reported by Alibaba | Not reported | Open |
| 23 | GLM-5.2Z.AIReported by Z.AI | 91.2% | Reported by Z.AI | Not reported | Open |
| 24 | Qwen3.8-Omni-FlashAlibabaReported by Alibaba | 91.0% | Reported by Alibaba | Not reported | Closed |
| 25 | DeepSeek V4.1 Flash 1017DeepSeekReported by DeepSeek | 90.9% | Reported by DeepSeek | Not reported | Open |
| 26 | Beam 1.0 501B-A23BReflection AIReported by Reflection AI | 90.6% | Reported by Reflection AI | Not reported | Open |
| 27 | Kimi K2.6Moonshot AIReported by Moonshot AI | 90.5% | Reported by Moonshot AI | Not reported | Open |
| 28 | Particle-1Particle AIReported by Particle AI | 90.4% | Reported by Particle AI | Not reported | Closed |
| 29 | Qwen3.7 PlusAlibabaReported by Alibaba | 90.3% | Reported by Alibaba | Not reported | Closed |
| 30 | Beam 1.0 501B-A23B FP8Reflection AIReported by Reflection AI | 90.3% | Reported by Reflection AI | Not reported | Open |
| 31 | DeepSeek V4 Pro 0813DeepSeekReported by DeepSeek | 90.1% | Reported by DeepSeek | Not reported | Open |
| 32 | Interfaze BetaInterfazeReported by Interfaze | 89.9% | Reported by Interfaze | Not reported | Closed |
| 33 | Nemotron 3.5 Super VL 120B A12B NVFP4NVIDIAReported by NVIDIA | 89.9% | Reported by NVIDIA | Not reported | Open |
| 34 | Nemotron 3.5 Super VL 120B A12BNVIDIAReported by NVIDIA | 89.5% | Reported by NVIDIA | Not reported | Open |
| 35 | Inkling-SmallThinking Machines LabReported by Thinking Machines Lab | 89.5% | Reported by Thinking Machines Lab | Not reported | Open |
| 36 | Muse SparkMetaReported by Meta | 89.5% | Reported by Meta | Not reported | Closed |
| 37 | Beam 1.0 501B-A23B NVFP4Reflection AIReported by Reflection AI | 89.3% | Reported by Reflection AI | Not reported | Open |
| 38 | Mercury 3InceptionReported by Inception | 89.2% | Reported by Inception | Not reported | Closed |
| 39 | Claude Opus 4.6AnthropicAnother lab’s comparison table | 89.2% | Another lab’s comparison table | Not reported | Closed |
| 40 | Qwen3.8-27BAlibabaReported by Alibaba | 89.2% | Reported by Alibaba | Not reported | Open |
| 41 | Ornith-1.5-35B-A3BOrnith AIReported by Ornith AI | 89.2% | Reported by Ornith AI | Not reported | Open |
| 42 | DeepSeek V4 Pro (High)DeepSeekReported by DeepSeek | 89.1% | Reported by DeepSeek | Not reported | Open |
| 43 | Solar Pro 4UpstageReported by Upstage | 89.0% | Reported by Upstage | Not reported | Closed |
| 44 | Nemotron 3.5 Bolt 74B-A9B BF16NVIDIAReported by NVIDIA | 88.8% | Reported by NVIDIA | Not reported | Open |
| 45 | Grok 4.20xAIReported by Meta AI (comparison table) | 88.5% | Reported by Meta AI (comparison table) | Not reported | Closed |
| 46 | OrcaCyber-Nano-1.0OrcaRouterReported by OrcaRouter | 88.3% | Reported by OrcaRouter | Not reported | Open |
| 47 | DeepSeek V4 Flash 0731DeepSeekReported by DeepSeek | 88.1% | Reported by DeepSeek | Not reported | Open |
| 48 | InklingThinking Machines LabReported by Thinking Machines Lab | 87.9% | Reported by Thinking Machines Lab | Not reported | Open |
| 49 | Kimi K2.5Moonshot AIReported by Moonshot AI | 87.6% | Reported by Moonshot AI | Not reported | Open |
| 50 | DeepSeek V4 Flash (High)DeepSeekReported by DeepSeek | 87.4% | Reported by DeepSeek | Not reported | Open |
| 51 | Hy3 PreviewTencentReported by Tencent | 87.2% | Reported by Tencent | Not reported | Open |
| 52 | MiniMax M2.7MiniMaxAnother lab’s comparison table | 87.0% | Another lab’s comparison table | Not reported | Open |
| 53 | Nemotron 3 UltraNVIDIAReported by NVIDIA | 87.0% | Reported by NVIDIA | Not reported | Open |
| 54 | Nemotron 3.5 Bolt 74B-A9BNVIDIAReported by NVIDIA | 86.4% | Reported by NVIDIA | Not reported | Open |
| 55 | Ornith-1.5-9BOrnith AIReported by Ornith AI | 86.4% | Reported by Ornith AI | Not reported | Open |
| 56 | Solar Open 2UpstageReported by Upstage | 86.3% | Reported by Upstage | Not reported | Open |
| 57 | GLM-5.1Z.AIReported by Z.AI | 86.2% | Reported by Z.AI | Not reported | Open |
| 58 | GLM-5Z.AIReported by Z.AI | 86.0% | Reported by Z.AI | Not reported | Open |
| 59 | Ternary Bonsai 2 27BPrism MLReported by Prism ML | 85.8% | Reported by Prism ML | Not reported | Open |
| 60 | A.X K2SK TelecomReported by SK Telecom | 85.6% | Reported by SK Telecom | Not reported | Open |
| 61 | Ripple-65B PreviewRicursive IntelligenceReported by Ricursive Intelligence | 85.2% | Reported by Ricursive Intelligence | Not reported | Open |
| 62 | Ling 3.0 FlashInclusionAIReported by InclusionAI | 85.0% | Reported by InclusionAI | Not reported | Open |
| 63 | MAI-Thinking-1MicrosoftReported by Microsoft | 84.2% | Reported by Microsoft | Not reported | Closed |
| 64 | Ling 3.0 Flash FP8InclusionAIReported by InclusionAI | 84.0% | Reported by InclusionAI | Not reported | Open |
| 65 | K-EXAONE 2.0LG AI ResearchReported by LG AI Research | 82.2% | Reported by LG AI Research | Not reported | Open |
| 66 | Mercury 2.5InceptionReported by Inception | 79.0% | Reported by Inception | Not reported | Closed |
| 67 | Gemma 4 12BGoogleReported by Google | 78.8% | Reported by Google | Not reported | Open |
| 68 | Spark-X2.6-4BSparkLLMReported by SparkLLM | 77.1% | Reported by SparkLLM | Not reported | Open |
| 69 | Trinity-Large-ThinkingArcee AIAnother lab’s comparison table | 76.3% | Another lab’s comparison table | Not reported | Open |
| 70 | Nemotron 3.5 Lightning 30B A3B NVFP4NVIDIAReported by NVIDIA | 75.6% | Reported by NVIDIA | Not reported | Open |
| 71 | LFM2.5-24B-A2BLiquidAIReported by LiquidAI | 74.4% | Reported by LiquidAI | Not reported | Open |
| 72 | Mercury 2InceptionReported by Inception | 73.6% | Reported by Inception | Not reported | Closed |
| 73 | DeepSeek V4 ProDeepSeekReported by DeepSeek | 72.9% | Reported by DeepSeek | Not reported | Open |
| 74 | Nemotron 3 Nano Omni 30B A3BNVIDIAReported by NVIDIA | 72.2% | Reported by NVIDIA | Not reported | Open |
| 75 | DeepSeek V4 FlashDeepSeekReported by DeepSeek | 71.2% | Reported by DeepSeek | Not reported | Open |
| 76 | ZAYA1-8BZyphraReported by Zyphra | 71.0% | Reported by Zyphra | Not reported | Open |
| 77 | MiniCPM5-2BOpenBMBReported by OpenBMB | 70.2% | Reported by OpenBMB | Not reported | Open |
| 78 | LongCat-Flash-Lite-SparseMeituanReported by Meituan | 69.5% | Reported by Meituan | Not reported | Open |
| 79 | Mellum2.1-12B-A2.5B-ThinkingJetBrainsReported by JetBrains | 64.6% | Reported by JetBrains | Not reported | Open |
| 80 | LFM3-1.7BLiquidAIReported by LiquidAI | 63.4% | Reported by LiquidAI | Not reported | Open |
| 81 | Trinity-Large-PreviewArcee AIReported by Arcee AI | 63.3% | Reported by Arcee AI | Not reported | Open |
| 82 | Mellum2-12B-A2.5B-ThinkingJetBrainsReported by JetBrains | 57.6% | Reported by JetBrains | Not reported | Open |
| 83 | ZAYA1-74B-PreviewZyphraReported by Zyphra | 57.3% | Reported by Zyphra | Not reported | Open |
| 84 | LLaDA2.2-miniInclusionAIReported by InclusionAI | 44.4% | Reported by InclusionAI | Not reported | Open |
| 85 | Soofi S 30B-A3BSoofi ProjectReported by Soofi Project | 43.4% | Reported by Soofi Project | Not reported | Open |
| 86 | Mellum2-12B-A2.5B-InstructJetBrainsReported by JetBrains | 40.9% | Reported by JetBrains | Not reported | Open |
| 87 | MiniCPM5-1BOpenBMBReported by OpenBMB | 26.3% | Reported by OpenBMB | Not reported | Open |
| 88 | LFM2.5-230MLiquidAIReported by LiquidAI | 25.4% | Reported by LiquidAI | Not reported | Open |
- Lab-reported
- Benchmark-run
- Independent
GPQA-D: reported scores versus Kaggle’s run
The highest reported GPQA-D score in the table above is 96.0 (GPT-6 Astra). The best row in Kaggle’s own run is 97.0 on zero-shot (Gemini 4 Carbon) and 97.4 on few-shot (Gemini 4 Carbon). 6 models have both a reported score and a Kaggle run on Kaggle’s zero-shot track. Kaggle’s number is lower for all 6, and the median gap is −4.8 points. The widest gap is Claude Opus 4.8: 93.6 reported, 84.3 on Kaggle.
Kaggle runs GPQA Diamond twice, without worked examples in the prompt and with them. Check which of the two a reported score used before comparing it. How Kaggle Benchmarks reruns tests.
| Source | Rows | Top score | Top row | Median |
|---|---|---|---|---|
| Reported (table above) | 88 | 96.0 | GPT-6 Astra | 88.7 |
| Kaggle: Zero-shot | 19 | 97.0 | Gemini 4 Carbon | 84.8 |
| Kaggle: Few-shot | 8 | 97.4 | Gemini 4 Carbon | 86.6 |
Same model, both numbers
| Model | Reported | Kaggle: Zero-shot | Kaggle: Few-shot |
|---|---|---|---|
| GPT-6 Astra | 96.0 | 92.9−3.1 | 94.9−1.1 |
| GPT-5.6 Sol | 94.6 | 92.9−1.7 | – |
| Claude Opus 4.8 | 93.6 | 84.3−9.3 | – |
| GPT-5.6 Terra | 92.9 | 86.4−6.5 | 79.3−13.6 |
| Gemini 3.5 Flash | 92.7 | 91.4−1.3 | – |
| GPT-5.6 Luna | 92.3 | 84.3−8.0 | 80.8−11.5 |
The small figure is Kaggle’s score minus the reported one, in points. A model is matched to its Kaggle row by Kaggle’s model version, and where Kaggle ran it at several settings the best row is shown. Reported is the score in the table above. Every Kaggle row is in the Kaggle tables below. Source: kaggle.com/benchmarks/open-benchmarks/gpqa.
AA-GPQA Diamond
BenchLM stores the Artificial Analysis GPQA Diamond result separately from the core GPQA lane because Artificial Analysis controls the evaluation configuration.
| Source rank | Source model or configuration | Score | Who ran it | Source setup | Parameters (B) | Open / closed |
|---|---|---|---|---|---|---|
| 1 | GPT-6 AstraOpenAI | 96.1% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 2 | Gemini 3.8 FlashGoogle | 95.3% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 3 | Grok 4.6xAI | 94.9% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 4 | Gemini 3.7 FlashGoogle | 94.5% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 5 | GPT-5.6 SolOpenAI | 94.1% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| No rank on this table | Gemini 3.1 ProGoogle | 94.1% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Closed |
| 6 | Claude Fable 5.1Anthropic | 93.7% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 7 | Kimi K3Moonshot AI | 93.5% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 8 | GPT-5.5OpenAI | 93.5% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 9 | Muse Spark 1.3Meta | 93.5% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 10 | Claude Opus 5Anthropic | 93.2% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 11 | Grok 4.5xAI | 93.1% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 12 | MiniMax M3MiniMax | 92.9% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| No rank on this table | DeepSeek V4 Pro 0813DeepSeek | 92.8% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| 13 | Gemini 3.6 FlashGoogle | 92.8% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| No rank on this table | Qwen3.8 Max PreviewAlibaba | 92.8% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Closed |
| 14 | Claude Fable 5Anthropic | 92.6% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 15 | GPT-5.6 TerraOpenAI | 92.5% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 16 | Qwen3.7 MaxAlibaba | 92.3% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 17 | Qwen3.8-Flash-NextAlibaba | 92.3% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 18 | Gemini 3.5 FlashGoogle | 92.2% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 19 | Claude Opus 4.8Anthropic | 92.0% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 20 | GPT-5.4OpenAI | 92.0% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 21 | GLM-5.3Z.AI | 91.7% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 22 | GPT-5.3 CodexOpenAI | 91.5% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| No rank on this table | GPT-5.3-Codex-SparkOpenAI | 91.5% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Closed |
| No rank on this table | Claude Opus 4.7 (Adaptive)Anthropic | 91.4% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Closed |
| 23 | Claude Sonnet 5Anthropic | 91.1% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 24 | GPT-5.6 LunaOpenAI | 91.1% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| No rank on this table | Kimi K2.6Moonshot AI | 91.1% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| 25 | Gemini 3 ProGoogle | 90.8% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| No rank on this table | DeepSeek V4 Flash 0731DeepSeek | 90.8% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| 26 | Qwen3.8-27BAlibaba | 90.5% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 27 | DeepSeek V4 Pro (High)DeepSeek | 90.5% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 28 | Muse Spark 1.2Meta | 90.4% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 29 | GPT-5.2OpenAI | 90.3% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 30 | Grok 4.3xAI | 90.1% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 31 | Qwen3.7 PlusAlibaba | 90.0% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 32 | GPT-5.2-CodexOpenAI | 89.9% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 33 | Muse Spark 1.1Meta | 89.8% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 34 | Hy3Tencent | 89.7% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| No rank on this table | Hy3 PreviewTencent | 89.7% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| 35 | Kimi K2.7 CodeMoonshot AI | 89.6% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| No rank on this table | Claude Opus 4.6 (Adaptive)Anthropic | 89.6% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Closed |
| 36 | GLM-5.2Z.AI | 89.5% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 37 | Inkling-SmallThinking Machines Lab | 89.5% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| No rank on this table | Qwen3.5 397BAlibaba | 89.3% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| No rank on this table | Qwen3.5 397B (Reasoning)Alibaba | 89.3% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| No rank on this table | Solar Pro 4Upstage | 89.1% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Closed |
| 38 | Muse Spark OpenMeta | 89.0% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| No rank on this table | Qwen 3.6 Max (preview)Alibaba | 88.8% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Closed |
| No rank on this table | Claude Opus 4.7Anthropic | 88.5% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Closed |
| 39 | Muse SparkMeta | 88.4% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 40 | Qwen3.6 PlusAlibaba | 88.2% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| No rank on this table | Kimi K2.5 (Reasoning)Moonshot AI | 87.9% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| 41 | Kimi K2.5Moonshot AI | 87.9% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 42 | Grok 4xAI | 87.7% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 43 | GPT-5.4 miniOpenAI | 87.5% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 44 | MiniMax M2.7MiniMax | 87.4% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 45 | GPT-5.1OpenAI | 87.3% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 46 | InklingThinking Machines Lab | 87.2% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 47 | MiMo-V2-ProXiaomi | 87.0% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 48 | GLM-5.1Z.AI | 86.8% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| No rank on this table | Nemotron 3 UltraNVIDIA | 86.7% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| 49 | MiMo-V2.5-ProXiaomi | 86.6% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 50 | Claude Opus 4.5 ThinkingAnthropic | 86.6% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 51 | Apodex 1.1Apodex | 86.4% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| No rank on this table | Apodex 1.1 MiniApodex | 86.4% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| 52 | Ling 3.0 Flash VLInclusionAI | 86.2% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 53 | GPT-5.1-CodexOpenAI | 86.0% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| No rank on this table | GPT-5.1-Codex-MaxOpenAI | 86.0% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Closed |
| 54 | GLM-4.7Z.AI | 85.9% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 55 | Qwen3.5-27BAlibaba | 85.8% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 56 | Qwen3.5-122B-A10BAlibaba | 85.7% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 57 | Gemma 4 31BGoogle | 85.7% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 58 | A.X K2SK Telecom | 85.7% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 59 | Ling 3.0 FlashInclusionAI | 85.5% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| No rank on this table | GPT-5 (high)OpenAI | 85.4% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Closed |
| 60 | Grok 4.1 Fast (Reasoning)xAI | 85.3% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 61 | MiniMax M2.5MiniMax | 84.8% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 62 | GLM-5-TurboZ.AI | 84.7% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 63 | Grok 4 Fast (Reasoning)xAI | 84.7% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 64 | Qwen3.5-35B-A3BAlibaba | 84.5% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 65 | o3-proOpenAI | 84.5% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 66 | Gemini 2.5 ProGoogle | 84.4% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 67 | Qwen3.6-27BAlibaba | 84.2% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 68 | GPT-5 (medium)OpenAI | 84.2% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 69 | Qwen3.6-35B-A3BAlibaba | 84.1% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 70 | Claude Opus 4.6Anthropic | 84.0% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 71 | Gemini 3.5 Flash-LiteGoogle | 83.8% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 72 | Muse Glimmer 30BMeta | 83.5% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| No rank on this table | K-EXAONE 2.0LG AI Research | 82.9% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| 73 | MiMo-V2-OmniXiaomi | 82.8% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 74 | GPT-5 miniOpenAI | 82.8% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 75 | o3OpenAI | 82.7% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 76 | Step 3.5 FlashStepFun | 82.6% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 77 | GLM-5Z.AI | 82.0% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 78 | GPT-5.4 nanoOpenAI | 81.7% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 79 | DeepSeek-R1DeepSeek | 81.3% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 80 | Gemini 3 FlashGoogle | 81.2% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 81 | Claude Opus 4.5Anthropic | 81.0% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 82 | Claude 4.1 Opus ThinkingAnthropic | 80.9% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 83 | GLM-5V-TurboZ.AI | 80.9% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 84 | Step 3.7 FlashStepFun | 80.9% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 85 | Claude Sonnet 4.6Anthropic | 79.9% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 86 | Claude 4 Opus ThinkingAnthropic | 79.6% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 87 | Gemma 4 26B A4BGoogle | 79.2% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 88 | o4-miniOpenAI | 78.4% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 89 | K-ExaoneLG AI Research | 78.3% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 90 | GPT-OSS 120BOpenAI | 78.2% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 91 | DeepSeek V3.1 (Reasoning)DeepSeek | 77.9% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 92 | Claude 3.7 Sonnet ThinkingAnthropic | 77.2% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 93 | Qwen3.5-4BAlibaba | 77.1% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 94 | Mercury 2Inception | 77.0% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 95 | Mistral Small 4Mistral | 76.9% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| No rank on this table | Mistral Small 4 (Reasoning)Mistral | 76.9% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| 96 | Kimi K2Moonshot AI | 76.6% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 97 | o1-previewOpenAI | 76.5% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 98 | Qwen3 MaxAlibaba | 76.4% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 99 | Command A+Cohere | 76.1% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| No rank on this table | North Mini CodeCohere | 75.7% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| 100 | Gemma 4 12BGoogle | 75.3% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 101 | Trinity-Large-ThinkingArcee AI | 75.2% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| No rank on this table | Trinity-Large-PreviewArcee AI | 75.2% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| 102 | DeepSeek V3.2DeepSeek | 75.1% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 103 | Mistral Medium 3.5 128BMistral | 74.8% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 104 | o3-miniOpenAI | 74.8% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 105 | o1OpenAI | 74.7% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| No rank on this table | Nemotron 3.5 Lightning 30B A3B NVFP4NVIDIA | 74.3% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| 106 | Sarvam 105BSarvam | 73.8% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 107 | DeepSeek V3.1DeepSeek | 73.5% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 108 | Ling 3.0 TinyInclusionAI | 73.4% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 109 | GLM-4.5-AirZ.AI | 73.3% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 110 | Quasar 438BMultiverse Computing | 73.2% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| No rank on this table | Nemotron Ultra 253BNVIDIA | 72.8% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| 111 | Grok Code Fast 1xAI | 72.7% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| No rank on this table | Qwen3-Omni-30B-A3B-ThinkingAlibaba | 72.6% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| 112 | Solar Pro 3Upstage | 72.4% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 113 | MiniCPM5-2BOpenBMB | 70.2% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 114 | Claude 4 OpusAnthropic | 70.1% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 115 | MiniMax M1 80kMiniMax | 69.7% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 116 | GPT-OSS 20BOpenAI | 68.8% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 117 | Gemini 2.5 FlashGoogle | 68.3% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 118 | Claude 4 SonnetAnthropic | 68.3% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 119 | Mistral Large 3Mistral | 68.0% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 120 | Magistral MediumMistral | 67.9% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 121 | GPT-5 nanoOpenAI | 67.6% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 122 | Llama 4 MaverickMeta | 67.1% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 123 | GPT-4.1OpenAI | 66.6% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 124 | GPT-4.1 miniOpenAI | 66.4% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 125 | Claude 3.7 SonnetAnthropic | 65.6% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 126 | MiMo-V2-FlashXiaomi | 65.6% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 127 | DeepSeek V3 0324DeepSeek | 65.5% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 128 | Granite 4.2 30BIBM | 64.4% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 129 | Magistral SmallMistral | 64.1% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 130 | Grok 4.1 FastxAI | 63.7% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 131 | Sarvam 30BSarvam | 63.3% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 132 | GLM-4.6Z.AI | 63.2% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 133 | Celeris-1Celeris | 63.1% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 134 | Granite 4.2 8BIBM | 63.1% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 135 | Exaone 4.0 32BLG AI Research | 62.8% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 136 | Gemini 2.0 FlashGoogle | 62.3% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 137 | Qwen3-Omni-30B-A3B-InstructAlibaba | 62.0% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 138 | DeepSeek R1 Distill Qwen 32BDeepSeek | 61.5% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 139 | o1-miniOpenAI | 60.3% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 140 | QwQ-32BAlibaba | 59.3% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 141 | Ling 2.6 FlashInclusionAI | 59.3% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 142 | Gemini 1.5 ProGoogle | 58.9% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 143 | Llama 4 ScoutMeta | 58.7% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 144 | GLM-4.7-FlashZ.AI | 58.1% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 145 | Mistral Medium 3Mistral | 57.8% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 146 | Gemma 4 E4BGoogle | 57.6% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 147 | Phi-4Microsoft | 57.5% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| No rank on this table | Phi-4-reasoningMicrosoft | 57.5% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| No rank on this table | Ministral 3 14B (Reasoning)Mistral | 57.2% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| 148 | Ministral 3 14BMistral | 57.2% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 149 | Solar Pro 2Upstage | 56.1% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 150 | Granite 4.2 3BIBM | 55.9% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 151 | LFM2.5-2.6BLiquidAI | 55.8% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 152 | DeepSeek V3DeepSeek | 55.7% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 153 | GPT-4oOpenAI | 54.3% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| No rank on this table | Llama 3.1 405BMeta | 51.5% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| 154 | LFM2.5-8B-A1BLiquidAI | 51.3% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 155 | GPT-4.1 nanoOpenAI | 51.2% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 156 | Nova ProAmazon | 49.9% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| No rank on this table | Llama 3.3 70BMeta | 49.8% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| No rank on this table | Ultravox v0.6 Llama 3.3 70BFixie AI | 49.8% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| No rank on this table | Llama 3.1 70BMeta | 49.1% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| 157 | Claude 3 OpusAnthropic | 48.9% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 158 | Mistral Large 2Mistral | 48.6% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 159 | Gemini 2.5 Flash-LiteGoogle | 47.4% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 160 | LFM2-24B-A2BLiquidAI | 47.4% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| No rank on this table | Ministral 3 8B (Reasoning)Mistral | 47.1% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| 161 | Ministral 3 8BMistral | 47.1% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 162 | Nemotron 3 Nano Omni 30B A3BNVIDIA | 46.9% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 163 | Gemini 1.5 FlashGoogle | 46.3% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 164 | Mistral Small 3.1Mistral | 45.4% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 165 | Gemma 4 E2BGoogle | 43.3% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 166 | Gemma 3 27BGoogle | 42.8% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 167 | GPT-4o miniOpenAI | 42.6% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 168 | Exaone 4.0 1.2BLG AI Research | 42.4% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 169 | DeepSeek-V2.5DeepSeek | 42.3% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 170 | Qwen2.5 Coder 32B InstructAlibaba | 41.7% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 171 | Devstral SmallMistral | 41.4% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 172 | Claude 3.5 HaikuAnthropic | 40.8% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| No rank on this table | Nemotron 3 Nano 30BNVIDIA | 39.9% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| 173 | Claude 3 HaikuAnthropic | 37.4% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| No rank on this table | Ministral 3 3B (Reasoning)Mistral | 35.8% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| 174 | Ministral 3 3BMistral | 35.8% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 175 | LFM2.5-1.2B-ThinkingLiquidAI | 33.9% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 176 | LFM2.5-1.2B-InstructLiquidAI | 32.6% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| No rank on this table | Phi-4 Multimodal InstructMicrosoft | 31.5% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| No rank on this table | LFM2.5-VL-1.6B-ExtractLiquidAI | 28.9% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| 177 | Gemini 1.0 ProGoogle | 27.7% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| No rank on this table | Llama 3.1 8BMeta | 27.0% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| 178 | Granite-4.0-H-1BIBM | 26.3% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 179 | Granite-4.0-350MIBM | 26.1% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 180 | Granite-4.0-H-350MIBM | 25.7% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
GPQA Diamond (Vals)
BenchLM mirrors this Vals AI leaderboard for reference only. It is excluded from BenchLM overall and category rankings.
| Source rank | Source model or configuration | Vals GPQA Diamond mirror score | Source setup | Parameters (B) | Open / closed |
|---|---|---|---|---|---|
| 1 | Gemini 3.1 Pro PreviewGoogle | 95.5% | high reasoningOriginal result | Not reported | Unknown |
| 2 | GPT-5.6 SolOpenAI | 95.2% | max reasoningOriginal result | Not reported | Closed |
| 3 | Grok 4.6xAI | 94.7% | high reasoningOriginal result | Not reported | Closed |
| 4 | Gemini 3.8 FlashGoogle | 94.4% | high reasoningOriginal result | Not reported | Closed |
| 5 | Gemini 3.7 FlashGoogle | 93.9% | high reasoningOriginal result | Not reported | Closed |
| 6 | Qwen3.8 MaxAlibaba | 93.7% | Vals AIOriginal result | Not reported | Open |
| 7 | Gemini 3.6 FlashGoogle | 93.4% | high reasoningOriginal result | Not reported | Closed |
| 8 | Claude Opus 5Anthropic | 93.4% | Vals AIOriginal result | Not reported | Closed |
| 9 | Claude Fable 5.1Anthropic | 93.4% | Vals AIOriginal result | Not reported | Closed |
| 10 | Claude Fable 5Anthropic | 93.2% | Vals AIOriginal result | Not reported | Closed |
| 11 | GPT-5.5OpenAI | 93.2% | xhigh reasoningOriginal result | Not reported | Closed |
| 12 | Kimi K3Moonshot AI | 92.9% | Vals AIOriginal result | Not reported | Open |
| 13 | Grok 4.5xAI | 92.9% | high reasoningOriginal result | Not reported | Closed |
| 14 | Gemini 3.5 FlashGoogle | 92.7% | high reasoningOriginal result | Not reported | Closed |
| 15 | MiniMax M3MiniMax | 92.7% | Vals AIOriginal result | Not reported | Open |
| 16 | Claude Opus 4.8Anthropic | 92.4% | Vals AIOriginal result | Not reported | Closed |
| 17 | DeepSeek V4 Pro 0813DeepSeek | 92.4% | max reasoningOriginal result | Not reported | Open |
| 18 | GPT-5.6 LunaOpenAI | 91.7% | max reasoningOriginal result | Not reported | Closed |
| 19 | Gemini 3 Pro PreviewGoogle | 91.7% | high reasoningOriginal result | Not reported | Unknown |
| 20 | GPT-5.2OpenAI | 91.7% | xhigh reasoningOriginal result | Not reported | Closed |
| 21 | GPT-5.4OpenAI | 91.7% | xhigh reasoningOriginal result | Not reported | Closed |
| 22 | Grok 4.3xAI | 91.4% | Vals AIOriginal result | Not reported | Closed |
| 23 | Muse Spark 1.1Meta | 91.2% | xhigh reasoningOriginal result | Not reported | Closed |
| 24 | GPT-5.6 TerraOpenAI | 90.9% | xhigh reasoningOriginal result | Not reported | Closed |
| 25 | Qwen3.7 MaxAlibaba | 90.2% | Vals AIOriginal result | Not reported | Closed |
| 26 | Claude Opus 4.7Anthropic | 90.2% | Vals AIOriginal result | Not reported | Closed |
| 27 | DeepSeek V4 Flash 0731DeepSeek | 89.9% | high reasoningOriginal result | Not reported | Open |
| 28 | Muse SparkMeta | 89.6% | Vals AIOriginal result | Not reported | Closed |
| 29 | Claude Opus 4.6 (Adaptive)Anthropic | 89.6% | Vals AIOriginal result | Not reported | Closed |
| 30 | DeepSeek V4 Pro 0813DeepSeek | 89.4% | max reasoningOriginal result | Not reported | Open |
| 31 | Kimi K2.6Moonshot AI | 89.1% | Vals AIOriginal result | Not reported | Open |
| 32 | Claude Sonnet 5Anthropic | 88.9% | Vals AIOriginal result | Not reported | Closed |
| 33 | Qwen3.8-27BAlibaba | 88.9% | xhigh reasoningOriginal result | Not reported | Open |
| 34 | Grok 4.20 0309 ReasoningxAI | 88.6% | Vals AIOriginal result | Not reported | Unknown |
| 35 | Grok 4 0709xAI | 88.1% | Vals AIOriginal result | Not reported | Unknown |
| 36 | GLM-5.3Z.AI | 88.1% | max reasoningOriginal result | Not reported | Open |
| 37 | Gemini 3 Flash PreviewGoogle | 87.9% | high reasoningOriginal result | Not reported | Unknown |
| 38 | Qwen3.5 Plus ThinkingAlibaba | 87.4% | Vals AIOriginal result | Not reported | Unknown |
| 39 | Qwen3.6 PlusAlibaba | 87.4% | Vals AIOriginal result | Not reported | Closed |
| 40 | InklingThinking Machines Lab | 87.1% | 0.99 reasoningOriginal result | Not reported | Open |
| 41 | GPT-5.1OpenAI | 86.6% | high reasoningOriginal result | Not reported | Closed |
| 42 | MiniMax M2.7MiniMax | 86.6% | Vals AIOriginal result | Not reported | Open |
| 43 | GLM-5.3-FlashZ.AI | 86.4% | max reasoningOriginal result | Not reported | Open |
| 44 | Nemotron 3 Ultra 550b A55bNvidia | 86.1% | Vals AIOriginal result | Not reported | Unknown |
| 45 | Claude Opus 4.5 ThinkingAnthropic | 85.9% | Vals AIOriginal result | Not reported | Closed |
| 46 | GPT-5OpenAI | 85.6% | high reasoningOriginal result | Not reported | Unknown |
| 47 | GLM-5.2Z.AI | 85.6% | Vals AIOriginal result | Not reported | Open |
| 48 | Claude Sonnet 4.6Anthropic | 85.6% | Vals AIOriginal result | Not reported | Closed |
| 49 | Grok 4 Fast (Reasoning)xAI | 85.4% | Vals AIOriginal result | Not reported | Closed |
| 50 | Ling 3.0 Flash 2607Ant | 84.8% | Vals AIOriginal result | Not reported | Unknown |
| 51 | Qwen3 MaxAlibaba | 84.8% | Vals AIOriginal result | Not reported | Closed |
| 52 | GLM-5.1Z.AI | 84.5% | Vals AIOriginal result | Not reported | Open |
| 53 | Grok 4.1 Fast (Reasoning)xAI | 84.3% | Vals AIOriginal result | Not reported | Closed |
| 54 | o3OpenAI | 84.1% | high reasoningOriginal result | Not reported | Closed |
| 55 | Kimi K2.5 ThinkingMoonshot AI | 84.1% | Vals AIOriginal result | Not reported | Unknown |
| 56 | Gemini 3.5 Flash-LiteGoogle | 83.8% | high reasoningOriginal result | Not reported | Closed |
| 57 | Inkling-SmallThinking Machines Lab | 83.6% | 0.99 reasoningOriginal result | Not reported | Open |
| 58 | GLM 5 ThinkingZhipu AI | 83.3% | Vals AIOriginal result | Not reported | Unknown |
| 59 | GPT-5.4 miniOpenAI | 83.1% | xhigh reasoningOriginal result | Not reported | Closed |
| 60 | Qwen3.5 FlashAlibaba | 82.8% | Vals AIOriginal result | Not reported | Closed |
| 61 | MiMo-V2.5-ProXiaomi | 82.6% | Vals AIOriginal result | Not reported | Closed |
| 62 | MiniMax M2.5MiniMax | 82.1% | Vals AIOriginal result | Not reported | Closed |
| 63 | Claude Sonnet 4.5 ThinkingAnthropic | 81.6% | Vals AIOriginal result | Not reported | Closed |
| 64 | Gemini 2.5 Flash Preview 09 2025Google | 81.6% | Vals AIOriginal result | Not reported | Unknown |
| 65 | MiMo-V2.5Xiaomi | 81.6% | Vals AIOriginal result | Not reported | Closed |
| 66 | Gemini 3.1 Flash Lite PreviewGoogle | 81.1% | high reasoningOriginal result | Not reported | Unknown |
| 67 | Gemini 2.5 Pro Exp 03 25Google | 80.8% | Vals AIOriginal result | Not reported | Unknown |
| 68 | GPT-5 miniOpenAI | 80.3% | high reasoningOriginal result | Not reported | Closed |
| 69 | DeepSeek V3p2 ThinkingFireworks AI | 80.3% | high reasoningOriginal result | Not reported | Unknown |
| 70 | GLM-4.7Z.AI | 80.0% | Vals AIOriginal result | Not reported | Open |
| 71 | Claude Opus 4.5Anthropic | 79.5% | Vals AIOriginal result | Not reported | Closed |
| 72 | Qwen3 MaxAlibaba | 79.5% | Vals AIOriginal result | Not reported | Closed |
| 73 | Grok 3 Mini Fast High ReasoningxAI | 79.3% | high reasoningOriginal result | Not reported | Unknown |
| 74 | GPT-OSS 120BOpenAI | 78.5% | Vals AIOriginal result | Not reported | Open |
| 75 | MiniMax M2.1MiniMax | 78.5% | Vals AIOriginal result | Not reported | Unknown |
| 76 | Kimi K2 ThinkingMoonshot AI | 78.5% | Vals AIOriginal result | Not reported | Unknown |
| 77 | Qwen3 Max PreviewAlibaba | 77.8% | Vals AIOriginal result | Not reported | Unknown |
| 78 | GPT-5.4 nanoOpenAI | 77.5% | high reasoningOriginal result | Not reported | Closed |
| 79 | Gemini 2.5 Flash Preview 09 2025 ThinkingGoogle | 76.5% | Vals AIOriginal result | Not reported | Unknown |
| 80 | Claude Opus 4.1 20250805 ThinkingAnthropic | 76.3% | Vals AIOriginal result | Not reported | Unknown |
| 81 | DeepSeek V3p2Fireworks AI | 76.3% | none reasoningOriginal result | Not reported | Unknown |
| 82 | o3-miniOpenAI | 75.5% | high reasoningOriginal result | Not reported | Closed |
| 83 | Claude 3.7 Sonnet ThinkingAnthropic | 75.3% | Vals AIOriginal result | Not reported | Closed |
| 84 | Claude Sonnet 4 20250514 ThinkingAnthropic | 75.0% | Vals AIOriginal result | Not reported | Unknown |
| 85 | o4-miniOpenAI | 74.5% | high reasoningOriginal result | Not reported | Closed |
| 86 | GLM-4.6Z.AI | 74.5% | Vals AIOriginal result | Not reported | Open |
| 87 | Grok 3xAI | 74.2% | Vals AIOriginal result | Not reported | Unknown |
| 88 | o1OpenAI | 73.2% | high reasoningOriginal result | Not reported | Closed |
| 89 | Grok 3 Mini Fast Low ReasoningxAI | 73.0% | low reasoningOriginal result | Not reported | Unknown |
| 90 | Claude Haiku 4.5 ThinkingAnthropic | 72.2% | Vals AIOriginal result | Not reported | Closed |
| 91 | GLM-4.5Z.AI | 72.2% | Vals AIOriginal result | Not reported | Closed |
| 92 | Claude Opus 4Anthropic | 71.7% | Vals AIOriginal result | Not reported | Unknown |
| 93 | Moonshotai Kimi K2 InstructTogether AI | 71.5% | Vals AIOriginal result | Not reported | Unknown |
| 94 | Gemini 2.5 Flash Lite Preview 09 2025 ThinkingGoogle | 70.2% | Vals AIOriginal result | Not reported | Unknown |
| 95 | Qwen3 235B-A22BAlibaba | 70.2% | Vals AIOriginal result | Not reported | Open |
| 96 | Claude Opus 4.1Anthropic | 70.0% | Vals AIOriginal result | Not reported | Unknown |
| 97 | Llama4 Maverick Instruct BasicFireworks AI | 69.4% | Vals AIOriginal result | Not reported | Unknown |
| 98 | Claude Sonnet 4Anthropic | 69.4% | Vals AIOriginal result | Not reported | Unknown |
| 99 | GPT-OSS 20BOpenAI | 68.9% | Vals AIOriginal result | Not reported | Open |
| 100 | Mistral Large 2512Mistral AI | 68.4% | Vals AIOriginal result | Not reported | Unknown |
| 101 | GPT-4.1 miniOpenAI | 67.9% | high reasoningOriginal result | Not reported | Closed |
| 102 | Claude 3.7 SonnetAnthropic | 67.4% | Vals AIOriginal result | Not reported | Closed |
| 103 | GPT-4.1OpenAI | 65.4% | high reasoningOriginal result | Not reported | Closed |
| 104 | Gemini 2.0 Flash 001Google | 65.2% | Vals AIOriginal result | Not reported | Unknown |
| 105 | Grok 4.1 Fast Non ReasoningxAI | 65.2% | Vals AIOriginal result | Not reported | Unknown |
| 106 | Gemini 2.5 Flash Lite Preview 09 2025Google | 64.1% | Vals AIOriginal result | Not reported | Unknown |
| 107 | GPT-5 nanoOpenAI | 63.4% | high reasoningOriginal result | Not reported | Closed |
| 108 | Langston Nim Nvidia Llama 3.3 Nemotron Super 49b V1 42e84561 ThinkingTogether AI | 62.4% | Vals AIOriginal result | Not reported | Unknown |
| 109 | Magistral Medium 2509Mistral AI | 62.4% | Vals AIOriginal result | Not reported | Unknown |
| 110 | Grok 4 Fast Non ReasoningxAI | 62.1% | Vals AIOriginal result | Not reported | Unknown |
| 111 | DeepSeek V3 0324DeepSeek | 61.6% | Vals AIOriginal result | Not reported | Open |
| 112 | Claude 3.5 SonnetAnthropic | 59.3% | Vals AIOriginal result | Not reported | Closed |
| 113 | MiMo-V2-FlashXiaomi | 59.3% | Vals AIOriginal result | Not reported | Open |
| 114 | Gemini 1.5 Pro 002Google | 58.3% | Vals AIOriginal result | Not reported | Unknown |
| 115 | Magistral Small 2509Mistral AI | 58.3% | Vals AIOriginal result | Not reported | Unknown |
| 116 | Gemini 2.5 Flash Preview 04 17Google | 57.6% | Vals AIOriginal result | Not reported | Unknown |
| 117 | Laguna XS.2Poolside | 55.0% | Vals AIOriginal result | Not reported | Open |
| 118 | DeepSeek V3DeepSeek | 54.5% | Vals AIOriginal result | Not reported | Open |
| 119 | GPT-4oOpenAI | 53.8% | high reasoningOriginal result | Not reported | Closed |
| 120 | GPT-4.1 nanoOpenAI | 50.8% | high reasoningOriginal result | Not reported | Closed |
| 121 | Mistral Small 2402Mistral AI | 50.8% | Vals AIOriginal result | Not reported | Unknown |
| 122 | Grok 2 1212xAI | 50.8% | Vals AIOriginal result | Not reported | Unknown |
| 123 | GPT-4oOpenAI | 50.3% | high reasoningOriginal result | Not reported | Closed |
| 124 | Meta Llama Llama 3.3 70B Instruct TurboTogether AI | 50.0% | Vals AIOriginal result | Not reported | Unknown |
| 125 | Command A 03 2025Cohere | 48.5% | Vals AIOriginal result | Not reported | Unknown |
| 126 | Mistral Large 2411Mistral AI | 47.7% | Vals AIOriginal result | Not reported | Unknown |
| 127 | Langston Nim Nvidia Llama 3.3 Nemotron Super 49b V1 42e84561Together AI | 47.7% | Vals AIOriginal result | Not reported | Unknown |
| 128 | Meta Llama Llama 4 Scout 17B 16E InstructTogether AI | 47.0% | Vals AIOriginal result | Not reported | Unknown |
| 129 | Gemini 1.5 Flash 002Google | 46.0% | Vals AIOriginal result | Not reported | Unknown |
| 130 | Mistral Small 2503Mistral AI | 44.2% | Vals AIOriginal result | Not reported | Unknown |
| 131 | GPT-4o miniOpenAI | 44.2% | high reasoningOriginal result | Not reported | Closed |
| 132 | Claude 3.5 HaikuAnthropic | 37.9% | Vals AIOriginal result | Not reported | Closed |
| 133 | Jamba Large 1.6AI21 Labs | 36.1% | Vals AIOriginal result | Not reported | Unknown |
| 134 | Mistral Medium 3.5Mistral AI | 34.8% | high reasoningOriginal result | Not reported | Unknown |
| 135 | Jamba Mini 1.6AI21 Labs | 32.1% | Vals AIOriginal result | Not reported | Unknown |
| 136 | Command R PlusCohere | 31.1% | Vals AIOriginal result | Not reported | Unknown |
| 137 | GPT-3.5 TurboOpenAI | 30.6% | high reasoningOriginal result | Not reported | Unknown |
| 138 | Laguna M.1Poolside | 27.0% | Vals AIOriginal result | Not reported | Closed |
GPQA Diamond Zero-Shot (Kaggle)
Native proportions are displayed as percentages. Source profiles, task versions, evaluation dates, and symmetric intervals stay attached to each row. Missing results are not zero. How Kaggle Benchmarks reruns tests.
| Source rank | Source model or configuration | Accuracy (%) | Source setup | Parameters (B) | Open / closed |
|---|---|---|---|---|---|
| 1 | Gemini 4 Carbon | 97.0% | Task version 5; Evaluated 2026-11-03Original result | Not reported | Unknown |
| 2 | Gemini 3.6 Flash | 93.4% | Task version 5; Evaluated 2026-10-08Original result | Not reported | Unknown |
| 3 | GPT-5.6 Sol | 92.9% | Task version 5; Evaluated 2026-10-08Original result | Not reported | Unknown |
| 4 | GPT-6 Astra | 92.9% | Task version 5; Evaluated 2026-10-08Original result | Not reported | Unknown |
| 5 | Gemini 3.5 Flash | 91.4% | Task version 5; Evaluated 2026-10-08Original result | Not reported | Unknown |
| 6 | Grok 4.5 | 90.9% | Task version 5; Evaluated 2026-10-09Original result | Not reported | Unknown |
| 7 | Claude Opus 5 | 90.9% | Task version 5; Evaluated 2026-10-09Original result | Not reported | Unknown |
| 8 | Gemini 3 Flash Preview | 90.4% | Task version 5; Evaluated 2026-10-08Original result | Not reported | Unknown |
| 9 | GPT-5.6 Terra | 86.4% | Task version 5; Evaluated 2026-10-08Original result | Not reported | Unknown |
| 10 | Gemma 4 31B | 84.8% | Task version 5; Evaluated 2026-10-07Original result | Not reported | Unknown |
| 11 | GPT-5 | 84.3% | Task version 5; Evaluated 2026-10-12Original result | Not reported | Unknown |
| 12 | GPT-5.6 Luna | 84.3% | Task version 5; Evaluated 2026-10-09Original result | Not reported | Unknown |
| 13 | Claude Opus 4.8 | 84.3% | Task version 5; Evaluated 2026-10-09Original result | Not reported | Unknown |
| 14 | Gemma 4 26B A4B | 83.2% | Task version 5; Evaluated 2026-10-09Original result | Not reported | Unknown |
| 15 | DeepSeek-R1 | 80.8% | Task version 5; Evaluated 2026-10-09Original result | Not reported | Unknown |
| 16 | Gemini 3.5 Flash-Lite | 74.7% | Task version 5; Evaluated 2026-10-07Original result | Not reported | Unknown |
| 17 | o4 mini | 71.7% | Task version 5; Evaluated 2026-10-12Original result | Not reported | Unknown |
| 18 | gpt-oss-120b | 70.7% | Task version 5; Evaluated 2026-10-09Original result | Not reported | Unknown |
| 19 | gpt-oss-20b | 62.1% | Task version 5; Evaluated 2026-10-12Original result | Not reported | Unknown |
GPQA Diamond Few-Shot (Kaggle)
Native proportions are displayed as percentages. Source profiles, task versions, evaluation dates, and symmetric intervals stay attached to each row. Missing results are not zero. How Kaggle Benchmarks reruns tests.
| Source rank | Source model or configuration | Accuracy (%) | Source setup | Parameters (B) | Open / closed |
|---|---|---|---|---|---|
| 1 | Gemini 4 Carbon | 97.4% | Task version 5; Evaluated 2026-11-03Original result | Not reported | Unknown |
| 2 | GPT-6 Astra | 94.9% | Task version 5; Evaluated 2026-10-24Original result | Not reported | Unknown |
| 3 | Claude Opus 5 | 92.9% | Task version 5; Evaluated 2026-10-24Original result | Not reported | Unknown |
| 4 | Gemini 3.6 Flash | 89.9% | Task version 5; Evaluated 2026-10-24Original result | Not reported | Unknown |
| 5 | Gemma 4 26B A4B | 83.2% | Task version 5; Evaluated 2026-10-24Original result | Not reported | Unknown |
| 6 | Gemma 4 31B | 82.8% | Task version 5; Evaluated 2026-10-24Original result | Not reported | Unknown |
| 7 | GPT-5.6 Luna | 80.8% | Task version 5; Evaluated 2026-10-24Original result | Not reported | Unknown |
| 8 | GPT-5.6 Terra | 79.3% | Task version 5; Evaluated 2026-10-24Original result | Not reported | Unknown |
GPQA Diamond Few-Shot (Kaggle, October 20 run)
Native proportions are displayed as percentages. Source profiles, task versions, evaluation dates, and symmetric intervals stay attached to each row. Missing results are not zero. How Kaggle Benchmarks reruns tests.
| Source rank | Source model or configuration | Accuracy (%) | Source setup | Parameters (B) | Open / closed |
|---|---|---|---|---|---|
| 1 | GPT-6 Astra | 93.9% | Task version 4; Evaluated 2026-09-15Original result | Not reported | Unknown |
| 2 | Grok 4.5 | 93.9% | Task version 4; Evaluated 2026-07-14Original result | Not reported | Unknown |
| 3 | Gemini 3 Pro Preview | 93.4% | Task version 4; Evaluated 2025-11-13Original result | Not reported | Unknown |
| 4 | Gemini 3.5 Flash | 92.4% | Task version 4; Evaluated 2026-06-28Original result | Not reported | Unknown |
| 5 | GPT-5.6 Sol | 92.4% | Task version 4; Evaluated 2026-07-15Original result | Not reported | Unknown |
| 6 | Claude Opus 5 | 89.9% | Task version 4; Evaluated 2026-07-27Original result | Not reported | Unknown |
| 7 | Gemini 3 Flash Preview | 89.9% | Task version 4; Evaluated 2026-06-28Original result | Not reported | Unknown |
| 8 | Grok 4 | 86.9% | Task version 4; Evaluated 2025-09-03Original result | Not reported | Unknown |
| 9 | Gemini 3.6 Flash | 86.4% | Task version 4; Evaluated 2026-07-22Original result | Not reported | Unknown |
| 10 | Gemma 4 31B | 86.4% | Task version 4; Evaluation date not reportedOriginal result | Not reported | Unknown |
| 11 | GPT-5.6 Terra | 84.3% | Task version 4; Evaluated 2026-07-15Original result | Not reported | Unknown |
| 12 | Gemini 2.5 Pro Preview | 83.8% | Task version 4; Evaluated 2025-06-06Original result | Not reported | Unknown |
| 13 | GPT-5 | 83.3% | Task version 4; Evaluated 2025-08-19Original result | Not reported | Unknown |
| 14 | Claude Opus 4.8 | 83.2% | Task version 4; Evaluated 2026-06-28Original result | Not reported | Unknown |
| 15 | GPT-5.6 Luna | 81.8% | Task version 4; Evaluated 2026-07-15Original result | Not reported | Unknown |
| 16 | DeepSeek-R1 | 80.3% | Task version 4; Evaluated 2025-06-04Original result | Not reported | Unknown |
| 17 | o3 | 80.3% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 18 | Gemma 4 26B A4B | 79.2% | Task version 4; Evaluation date not reportedOriginal result | Not reported | Unknown |
| 19 | o4 mini | 76.3% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 20 | o1 | 74.2% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 21 | o3 mini | 74.2% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 22 | Claude Opus 4.1 | 73.7% | Task version 4; Evaluated 2025-08-20Original result | Not reported | Unknown |
| 23 | Claude Opus 4 | 72.7% | Task version 4; Evaluated 2025-05-23Original result | Not reported | Unknown |
| 24 | Gemini 3.5 Flash-Lite | 72.7% | Task version 4; Evaluated 2026-07-22Original result | Not reported | Unknown |
| 25 | Grok 3 Mini | 72.2% | Task version 4; Evaluated 2025-05-26Original result | Not reported | Unknown |
| 26 | deepseek-v3.1 | 71.2% | Task version 4; Evaluated 2025-08-26Original result | Not reported | Unknown |
| 27 | Grok 3 | 70.2% | Task version 4; Evaluated 2025-05-26Original result | Not reported | Unknown |
| 28 | Claude 3.7 Sonnet | 66.7% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 29 | gpt-oss-120b | 66.2% | Task version 4; Evaluated 2025-08-19Original result | Not reported | Unknown |
| 30 | Claude Sonnet 4 | 65.7% | Task version 4; Evaluated 2025-05-23Original result | Not reported | Unknown |
| 31 | Gemini 2.0 Flash | 65.2% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 32 | GPT-4.1 | 64.6% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 33 | DeepSeek-V3 | 62.1% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 34 | Claude 3.5 Sonnet | 61.6% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 35 | Gemini 1.5 Pro | 60.6% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 36 | o1 mini | 60.6% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 37 | Mistral Large 2 | 55.6% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 38 | Grok 2 | 53.0% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 39 | GPT-4o | 50.0% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 40 | Gemini 1.5 Flash | 46.0% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 41 | Gemma 3 27B | 45.5% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 42 | GPT-4o mini | 42.9% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 43 | Claude 3.5 Haiku | 40.9% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 44 | Granite 4.0 Small | 40.9% | Task version 4; Evaluated 2025-09-30Original result | Not reported | Unknown |
| 45 | gpt-oss-20b | 37.9% | Task version 4; Evaluated 2025-08-19Original result | Not reported | Unknown |
| 46 | Gemma 3 12B | 35.4% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 47 | Ministral 8B | 34.8% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 48 | Mixtral 8x22B | 34.8% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 49 | Codestral | 33.3% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 50 | Gemini 1.5 Flash 8B | 32.3% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 51 | GPT-3.5 Turbo | 30.3% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 52 | Ministral 3B | 30.3% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 53 | Gemma 3 4B | 26.8% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 54 | Gemini 2.5 Flash Preview | 25.3% | Task version 4; Evaluated 2025-05-23Original result | Not reported | Unknown |
| 55 | Qwen 3 235B A22B Thinking | 12.1% | Task version 4; Evaluated 2025-08-19Original result | Not reported | Unknown |
Among the reported GPQA-D rows, GPT-6 Astra is first at 96.0%. The third row is 0.5 points behind. The broader top-10 range is 2.5 points, so many of the published results sit in a relatively narrow band.
88 models have been evaluated on GPQA-D. The benchmark falls in the Knowledge category. GPQA-D is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.
About GPQA-D
Year
2023
Tasks
Graduate-level science questions
Format
Multiple choice questions
Difficulty
Graduate level
BenchLM stores GPQA-D separately from the standardized GPQA row when providers publish exact chart values that should not overwrite the core weighted benchmark.
Freshness and provenance
Version
GPQA-D 2023
Refresh cadence
Static
Staleness state
Stale
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
Questions
What does GPQA-D measure?
A display-only GPQA Diamond reference from provider comparison charts.
Which model scores highest on GPQA-D?
GPT-6 Astra by OpenAI currently leads with a score of 96.0% on GPQA-D.
How many models are evaluated on GPQA-D?
88 AI models have published results on GPQA-D in the BenchLM catalog.
Know when it’s worth switching models
The model to choose, the cheaper alternative, and the release we would wait on.
Read a sample issueJoin 7,000+ subscribers.
One email each week. Unsubscribe anytime.