Skip to main content
BenchLM
Data

GPQA Diamond (GPQA-D)

We show this table for reference; we do not rank on it.

Data verified

A display-only GPQA Diamond reference from provider comparison charts.

Benchmark score on GPQA-D — November 15, 2026

We compile the GPQA-D rows from provider self-reports and secondary reports. GPT-6 Astra leads the table at 96.0%, followed by Sakana Fugu-Ultra (95.5%) and Sakana Fugu (95.5%). We do not use these results to rank models overall.

88 modelsKnowledgeStaleDisplay onlyUpdated November 15, 2026

Benchmark score table (88 models)

None of the 88 results on this page has a documented run by the benchmark or an independent evaluator: 81 reported by the labs that built the models and 7 reported in another publisher’s document.

Benchmark score results for GPQA-D
RankModel / configurationScoreParameters (B)Open / closed
1GPT-6 AstraOpenAIReported by OpenAI
96.0%
Not reportedClosed
2Sakana Fugu-UltraSakana AIReported by Sakana AI
95.5%
Not reportedClosed
3Sakana FuguSakana AIReported by Sakana AI
95.5%
Not reportedClosed
4GPT-5.6 SolOpenAIReported by OpenAI
94.6%
Not reportedClosed
5Gemini 3.1 ProGoogleReported by Meta AI (comparison table)
94.3%
Not reportedClosed
6Claude Opus 4.7 (Adaptive)AnthropicReported by Anthropic
94.2%
Not reportedClosed
7Kimi K3.1 ProMoonshot AIReported by Moonshot AI
94.2%
Not reportedOpen
8Claude Opus 4.8AnthropicReported by Anthropic
93.6%
Not reportedClosed
9GPT-5.5OpenAIReported by OpenAI
93.6%
Not reportedClosed
10Kimi K3Moonshot AIReported by Moonshot AI
93.5%
Not reportedOpen
11Step 5 PreviewStepFunReported by StepFun
93.5%
Not reportedOpen
12Inkling 2 SmallThinking Machines LabReported by Thinking Machines Lab
93.0%
Not reportedClosed
13GPT-5.6 TerraOpenAIReported by OpenAI
92.9%
Not reportedClosed
14GPT-5.4OpenAIReported by Meta AI (comparison table)
92.8%
Not reportedClosed
15Ornith-1.5-397BOrnith AIReported by Ornith AI
92.8%
Not reportedOpen
16Gemini 3.5 FlashGoogleReported by a third party
92.7%
Not reportedClosed
17Qwen3.8 MaxAlibabaReported by Alibaba
92.6%
Not reportedOpen
18Qwen3.7 MaxAlibabaReported by Alibaba
92.4%
Not reportedClosed
19Pareto 26.10 PreviewUnbiasedReported by Unbiased
92.4%
Not reportedClosed
20GPT-5.6 LunaOpenAIReported by OpenAI
92.3%
Not reportedClosed
21Hy4 previewTencentReported by Tencent
92.3%
Not reportedOpen
22Qwen3.8-Flash-NextAlibabaReported by Alibaba
91.7%
Not reportedOpen
23GLM-5.2Z.AIReported by Z.AI
91.2%
Not reportedOpen
24Qwen3.8-Omni-FlashAlibabaReported by Alibaba
91.0%
Not reportedClosed
25DeepSeek V4.1 Flash 1017DeepSeekReported by DeepSeek
90.9%
Not reportedOpen
26Beam 1.0 501B-A23BReflection AIReported by Reflection AI
90.6%
Not reportedOpen
27Kimi K2.6Moonshot AIReported by Moonshot AI
90.5%
Not reportedOpen
28Particle-1Particle AIReported by Particle AI
90.4%
Not reportedClosed
29Qwen3.7 PlusAlibabaReported by Alibaba
90.3%
Not reportedClosed
30Beam 1.0 501B-A23B FP8Reflection AIReported by Reflection AI
90.3%
Not reportedOpen
31DeepSeek V4 Pro 0813DeepSeekReported by DeepSeek
90.1%
Not reportedOpen
32Interfaze BetaInterfazeReported by Interfaze
89.9%
Not reportedClosed
33Nemotron 3.5 Super VL 120B A12B NVFP4NVIDIAReported by NVIDIA
89.9%
Not reportedOpen
34Nemotron 3.5 Super VL 120B A12BNVIDIAReported by NVIDIA
89.5%
Not reportedOpen
35Inkling-SmallThinking Machines LabReported by Thinking Machines Lab
89.5%
Not reportedOpen
36Muse SparkMetaReported by Meta
89.5%
Not reportedClosed
37Beam 1.0 501B-A23B NVFP4Reflection AIReported by Reflection AI
89.3%
Not reportedOpen
38Mercury 3InceptionReported by Inception
89.2%
Not reportedClosed
39Claude Opus 4.6AnthropicAnother lab’s comparison table
89.2%
Not reportedClosed
40Qwen3.8-27BAlibabaReported by Alibaba
89.2%
Not reportedOpen
41Ornith-1.5-35B-A3BOrnith AIReported by Ornith AI
89.2%
Not reportedOpen
42DeepSeek V4 Pro (High)DeepSeekReported by DeepSeek
89.1%
Not reportedOpen
43Solar Pro 4UpstageReported by Upstage
89.0%
Not reportedClosed
44Nemotron 3.5 Bolt 74B-A9B BF16NVIDIAReported by NVIDIA
88.8%
Not reportedOpen
45Grok 4.20xAIReported by Meta AI (comparison table)
88.5%
Not reportedClosed
46OrcaCyber-Nano-1.0OrcaRouterReported by OrcaRouter
88.3%
Not reportedOpen
47DeepSeek V4 Flash 0731DeepSeekReported by DeepSeek
88.1%
Not reportedOpen
48InklingThinking Machines LabReported by Thinking Machines Lab
87.9%
Not reportedOpen
49Kimi K2.5Moonshot AIReported by Moonshot AI
87.6%
Not reportedOpen
50DeepSeek V4 Flash (High)DeepSeekReported by DeepSeek
87.4%
Not reportedOpen
51Hy3 PreviewTencentReported by Tencent
87.2%
Not reportedOpen
52MiniMax M2.7MiniMaxAnother lab’s comparison table
87.0%
Not reportedOpen
53Nemotron 3 UltraNVIDIAReported by NVIDIA
87.0%
Not reportedOpen
54Nemotron 3.5 Bolt 74B-A9BNVIDIAReported by NVIDIA
86.4%
Not reportedOpen
55Ornith-1.5-9BOrnith AIReported by Ornith AI
86.4%
Not reportedOpen
56Solar Open 2UpstageReported by Upstage
86.3%
Not reportedOpen
57GLM-5.1Z.AIReported by Z.AI
86.2%
Not reportedOpen
58GLM-5Z.AIReported by Z.AI
86.0%
Not reportedOpen
59Ternary Bonsai 2 27BPrism MLReported by Prism ML
85.8%
Not reportedOpen
60A.X K2SK TelecomReported by SK Telecom
85.6%
Not reportedOpen
61Ripple-65B PreviewRicursive IntelligenceReported by Ricursive Intelligence
85.2%
Not reportedOpen
62Ling 3.0 FlashInclusionAIReported by InclusionAI
85.0%
Not reportedOpen
63MAI-Thinking-1MicrosoftReported by Microsoft
84.2%
Not reportedClosed
64Ling 3.0 Flash FP8InclusionAIReported by InclusionAI
84.0%
Not reportedOpen
65K-EXAONE 2.0LG AI ResearchReported by LG AI Research
82.2%
Not reportedOpen
66Mercury 2.5InceptionReported by Inception
79.0%
Not reportedClosed
67Gemma 4 12BGoogleReported by Google
78.8%
Not reportedOpen
68Spark-X2.6-4BSparkLLMReported by SparkLLM
77.1%
Not reportedOpen
69Trinity-Large-ThinkingArcee AIAnother lab’s comparison table
76.3%
Not reportedOpen
70Nemotron 3.5 Lightning 30B A3B NVFP4NVIDIAReported by NVIDIA
75.6%
Not reportedOpen
71LFM2.5-24B-A2BLiquidAIReported by LiquidAI
74.4%
Not reportedOpen
72Mercury 2InceptionReported by Inception
73.6%
Not reportedClosed
73DeepSeek V4 ProDeepSeekReported by DeepSeek
72.9%
Not reportedOpen
74Nemotron 3 Nano Omni 30B A3BNVIDIAReported by NVIDIA
72.2%
Not reportedOpen
75DeepSeek V4 FlashDeepSeekReported by DeepSeek
71.2%
Not reportedOpen
76ZAYA1-8BZyphraReported by Zyphra
71.0%
Not reportedOpen
77MiniCPM5-2BOpenBMBReported by OpenBMB
70.2%
Not reportedOpen
78LongCat-Flash-Lite-SparseMeituanReported by Meituan
69.5%
Not reportedOpen
79Mellum2.1-12B-A2.5B-ThinkingJetBrainsReported by JetBrains
64.6%
Not reportedOpen
80LFM3-1.7BLiquidAIReported by LiquidAI
63.4%
Not reportedOpen
81Trinity-Large-PreviewArcee AIReported by Arcee AI
63.3%
Not reportedOpen
82Mellum2-12B-A2.5B-ThinkingJetBrainsReported by JetBrains
57.6%
Not reportedOpen
83ZAYA1-74B-PreviewZyphraReported by Zyphra
57.3%
Not reportedOpen
84LLaDA2.2-miniInclusionAIReported by InclusionAI
44.4%
Not reportedOpen
85Soofi S 30B-A3BSoofi ProjectReported by Soofi Project
43.4%
Not reportedOpen
86Mellum2-12B-A2.5B-InstructJetBrainsReported by JetBrains
40.9%
Not reportedOpen
87MiniCPM5-1BOpenBMBReported by OpenBMB
26.3%
Not reportedOpen
88LFM2.5-230MLiquidAIReported by LiquidAI
25.4%
Not reportedOpen
  • Lab-reported
  • Benchmark-run
  • Independent
What the labels mean

GPQA-D: reported scores versus Kaggle’s run

The highest reported GPQA-D score in the table above is 96.0 (GPT-6 Astra). The best row in Kaggle’s own run is 97.0 on zero-shot (Gemini 4 Carbon) and 97.4 on few-shot (Gemini 4 Carbon). 6 models have both a reported score and a Kaggle run on Kaggle’s zero-shot track. Kaggle’s number is lower for all 6, and the median gap is −4.8 points. The widest gap is Claude Opus 4.8: 93.6 reported, 84.3 on Kaggle.

Kaggle runs GPQA Diamond twice, without worked examples in the prompt and with them. Check which of the two a reported score used before comparing it. How Kaggle Benchmarks reruns tests.

GPQA-D: the reported table and each Kaggle board, with row count, top score, and median score
SourceRowsTop scoreTop rowMedian
Reported (table above)8896.0GPT-6 Astra88.7
Kaggle: Zero-shot1997.0Gemini 4 Carbon84.8
Kaggle: Few-shot897.4Gemini 4 Carbon86.6

Same model, both numbers

GPQA-D: the reported score and Kaggle’s own run for each model that has both, with the difference in points
ModelReportedKaggle: Zero-shotKaggle: Few-shot
GPT-6 Astra96.092.9−3.194.9−1.1
GPT-5.6 Sol94.692.9−1.7–
Claude Opus 4.893.684.3−9.3–
GPT-5.6 Terra92.986.4−6.579.3−13.6
Gemini 3.5 Flash92.791.4−1.3–
GPT-5.6 Luna92.384.3−8.080.8−11.5

The small figure is Kaggle’s score minus the reported one, in points. A model is matched to its Kaggle row by Kaggle’s model version, and where Kaggle ran it at several settings the best row is shown. Reported is the score in the table above. Every Kaggle row is in the Kaggle tables below. Source: kaggle.com/benchmarks/open-benchmarks/gpqa.

AA-GPQA Diamond

BenchLM stores the Artificial Analysis GPQA Diamond result separately from the core GPQA lane because Artificial Analysis controls the evaluation configuration.

AA-GPQA Diamond; source configurations remain separate from the canonical benchmark table.
Source rankSource model or configurationScoreWho ran itSource setupParameters (B)Open / closed
1GPT-6 AstraOpenAI96.1%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
2Gemini 3.8 FlashGoogle95.3%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
3Grok 4.6xAI94.9%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
4Gemini 3.7 FlashGoogle94.5%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
5GPT-5.6 SolOpenAI94.1%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
No rank on this tableGemini 3.1 ProGoogle94.1%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedClosed
6Claude Fable 5.1Anthropic93.7%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
7Kimi K3Moonshot AI93.5%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
8GPT-5.5OpenAI93.5%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
9Muse Spark 1.3Meta93.5%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
10Claude Opus 5Anthropic93.2%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
11Grok 4.5xAI93.1%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
12MiniMax M3MiniMax92.9%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
No rank on this tableDeepSeek V4 Pro 0813DeepSeek92.8%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedOpen
13Gemini 3.6 FlashGoogle92.8%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
No rank on this tableQwen3.8 Max PreviewAlibaba92.8%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedClosed
14Claude Fable 5Anthropic92.6%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
15GPT-5.6 TerraOpenAI92.5%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
16Qwen3.7 MaxAlibaba92.3%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
17Qwen3.8-Flash-NextAlibaba92.3%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
18Gemini 3.5 FlashGoogle92.2%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
19Claude Opus 4.8Anthropic92.0%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
20GPT-5.4OpenAI92.0%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
21GLM-5.3Z.AI91.7%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
22GPT-5.3 CodexOpenAI91.5%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
No rank on this tableGPT-5.3-Codex-SparkOpenAI91.5%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedClosed
No rank on this tableClaude Opus 4.7 (Adaptive)Anthropic91.4%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedClosed
23Claude Sonnet 5Anthropic91.1%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
24GPT-5.6 LunaOpenAI91.1%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
No rank on this tableKimi K2.6Moonshot AI91.1%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedOpen
25Gemini 3 ProGoogle90.8%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
No rank on this tableDeepSeek V4 Flash 0731DeepSeek90.8%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedOpen
26Qwen3.8-27BAlibaba90.5%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
27DeepSeek V4 Pro (High)DeepSeek90.5%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
28Muse Spark 1.2Meta90.4%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
29GPT-5.2OpenAI90.3%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
30Grok 4.3xAI90.1%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
31Qwen3.7 PlusAlibaba90.0%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
32GPT-5.2-CodexOpenAI89.9%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
33Muse Spark 1.1Meta89.8%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
34Hy3Tencent89.7%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
No rank on this tableHy3 PreviewTencent89.7%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedOpen
35Kimi K2.7 CodeMoonshot AI89.6%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
No rank on this tableClaude Opus 4.6 (Adaptive)Anthropic89.6%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedClosed
36GLM-5.2Z.AI89.5%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
37Inkling-SmallThinking Machines Lab89.5%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
No rank on this tableQwen3.5 397BAlibaba89.3%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedOpen
No rank on this tableQwen3.5 397B (Reasoning)Alibaba89.3%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedOpen
No rank on this tableSolar Pro 4Upstage89.1%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedClosed
38Muse Spark OpenMeta89.0%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
No rank on this tableQwen 3.6 Max (preview)Alibaba88.8%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedClosed
No rank on this tableClaude Opus 4.7Anthropic88.5%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedClosed
39Muse SparkMeta88.4%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
40Qwen3.6 PlusAlibaba88.2%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
No rank on this tableKimi K2.5 (Reasoning)Moonshot AI87.9%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedOpen
41Kimi K2.5Moonshot AI87.9%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
42Grok 4xAI87.7%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
43GPT-5.4 miniOpenAI87.5%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
44MiniMax M2.7MiniMax87.4%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
45GPT-5.1OpenAI87.3%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
46InklingThinking Machines Lab87.2%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
47MiMo-V2-ProXiaomi87.0%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
48GLM-5.1Z.AI86.8%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
No rank on this tableNemotron 3 UltraNVIDIA86.7%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedOpen
49MiMo-V2.5-ProXiaomi86.6%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
50Claude Opus 4.5 ThinkingAnthropic86.6%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
51Apodex 1.1Apodex86.4%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
No rank on this tableApodex 1.1 MiniApodex86.4%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedOpen
52Ling 3.0 Flash VLInclusionAI86.2%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
53GPT-5.1-CodexOpenAI86.0%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
No rank on this tableGPT-5.1-Codex-MaxOpenAI86.0%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedClosed
54GLM-4.7Z.AI85.9%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
55Qwen3.5-27BAlibaba85.8%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
56Qwen3.5-122B-A10BAlibaba85.7%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
57Gemma 4 31BGoogle85.7%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
58A.X K2SK Telecom85.7%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
59Ling 3.0 FlashInclusionAI85.5%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
No rank on this tableGPT-5 (high)OpenAI85.4%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedClosed
60Grok 4.1 Fast (Reasoning)xAI85.3%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
61MiniMax M2.5MiniMax84.8%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
62GLM-5-TurboZ.AI84.7%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
63Grok 4 Fast (Reasoning)xAI84.7%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
64Qwen3.5-35B-A3BAlibaba84.5%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
65o3-proOpenAI84.5%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
66Gemini 2.5 ProGoogle84.4%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
67Qwen3.6-27BAlibaba84.2%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
68GPT-5 (medium)OpenAI84.2%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
69Qwen3.6-35B-A3BAlibaba84.1%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
70Claude Opus 4.6Anthropic84.0%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
71Gemini 3.5 Flash-LiteGoogle83.8%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
72Muse Glimmer 30BMeta83.5%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
No rank on this tableK-EXAONE 2.0LG AI Research82.9%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedOpen
73MiMo-V2-OmniXiaomi82.8%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
74GPT-5 miniOpenAI82.8%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
75o3OpenAI82.7%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
76Step 3.5 FlashStepFun82.6%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
77GLM-5Z.AI82.0%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
78GPT-5.4 nanoOpenAI81.7%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
79DeepSeek-R1DeepSeek81.3%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
80Gemini 3 FlashGoogle81.2%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
81Claude Opus 4.5Anthropic81.0%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
82Claude 4.1 Opus ThinkingAnthropic80.9%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
83GLM-5V-TurboZ.AI80.9%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
84Step 3.7 FlashStepFun80.9%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
85Claude Sonnet 4.6Anthropic79.9%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
86Claude 4 Opus ThinkingAnthropic79.6%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
87Gemma 4 26B A4BGoogle79.2%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
88o4-miniOpenAI78.4%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
89K-ExaoneLG AI Research78.3%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
90GPT-OSS 120BOpenAI78.2%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
91DeepSeek V3.1 (Reasoning)DeepSeek77.9%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
92Claude 3.7 Sonnet ThinkingAnthropic77.2%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
93Qwen3.5-4BAlibaba77.1%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
94Mercury 2Inception77.0%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
95Mistral Small 4Mistral76.9%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
No rank on this tableMistral Small 4 (Reasoning)Mistral76.9%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedOpen
96Kimi K2Moonshot AI76.6%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
97o1-previewOpenAI76.5%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
98Qwen3 MaxAlibaba76.4%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
99Command A+Cohere76.1%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
No rank on this tableNorth Mini CodeCohere75.7%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedOpen
100Gemma 4 12BGoogle75.3%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
101Trinity-Large-ThinkingArcee AI75.2%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
No rank on this tableTrinity-Large-PreviewArcee AI75.2%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedOpen
102DeepSeek V3.2DeepSeek75.1%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
103Mistral Medium 3.5 128BMistral74.8%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
104o3-miniOpenAI74.8%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
105o1OpenAI74.7%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
No rank on this tableNemotron 3.5 Lightning 30B A3B NVFP4NVIDIA74.3%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedOpen
106Sarvam 105BSarvam73.8%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
107DeepSeek V3.1DeepSeek73.5%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
108Ling 3.0 TinyInclusionAI73.4%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
109GLM-4.5-AirZ.AI73.3%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
110Quasar 438BMultiverse Computing73.2%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
No rank on this tableNemotron Ultra 253BNVIDIA72.8%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedOpen
111Grok Code Fast 1xAI72.7%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
No rank on this tableQwen3-Omni-30B-A3B-ThinkingAlibaba72.6%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedOpen
112Solar Pro 3Upstage72.4%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
113MiniCPM5-2BOpenBMB70.2%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
114Claude 4 OpusAnthropic70.1%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
115MiniMax M1 80kMiniMax69.7%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
116GPT-OSS 20BOpenAI68.8%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
117Gemini 2.5 FlashGoogle68.3%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
118Claude 4 SonnetAnthropic68.3%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
119Mistral Large 3Mistral68.0%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
120Magistral MediumMistral67.9%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
121GPT-5 nanoOpenAI67.6%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
122Llama 4 MaverickMeta67.1%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
123GPT-4.1OpenAI66.6%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
124GPT-4.1 miniOpenAI66.4%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
125Claude 3.7 SonnetAnthropic65.6%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
126MiMo-V2-FlashXiaomi65.6%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
127DeepSeek V3 0324DeepSeek65.5%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
128Granite 4.2 30BIBM64.4%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
129Magistral SmallMistral64.1%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
130Grok 4.1 FastxAI63.7%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
131Sarvam 30BSarvam63.3%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
132GLM-4.6Z.AI63.2%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
133Celeris-1Celeris63.1%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
134Granite 4.2 8BIBM63.1%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
135Exaone 4.0 32BLG AI Research62.8%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
136Gemini 2.0 FlashGoogle62.3%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
137Qwen3-Omni-30B-A3B-InstructAlibaba62.0%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
138DeepSeek R1 Distill Qwen 32BDeepSeek61.5%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
139o1-miniOpenAI60.3%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
140QwQ-32BAlibaba59.3%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
141Ling 2.6 FlashInclusionAI59.3%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
142Gemini 1.5 ProGoogle58.9%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
143Llama 4 ScoutMeta58.7%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
144GLM-4.7-FlashZ.AI58.1%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
145Mistral Medium 3Mistral57.8%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
146Gemma 4 E4BGoogle57.6%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
147Phi-4Microsoft57.5%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
No rank on this tablePhi-4-reasoningMicrosoft57.5%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedOpen
No rank on this tableMinistral 3 14B (Reasoning)Mistral57.2%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedOpen
148Ministral 3 14BMistral57.2%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
149Solar Pro 2Upstage56.1%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
150Granite 4.2 3BIBM55.9%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
151LFM2.5-2.6BLiquidAI55.8%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
152DeepSeek V3DeepSeek55.7%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
153GPT-4oOpenAI54.3%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
No rank on this tableLlama 3.1 405BMeta51.5%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedOpen
154LFM2.5-8B-A1BLiquidAI51.3%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
155GPT-4.1 nanoOpenAI51.2%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
156Nova ProAmazon49.9%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
No rank on this tableLlama 3.3 70BMeta49.8%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedOpen
No rank on this tableUltravox v0.6 Llama 3.3 70BFixie AI49.8%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedOpen
No rank on this tableLlama 3.1 70BMeta49.1%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedOpen
157Claude 3 OpusAnthropic48.9%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
158Mistral Large 2Mistral48.6%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
159Gemini 2.5 Flash-LiteGoogle47.4%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
160LFM2-24B-A2BLiquidAI47.4%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
No rank on this tableMinistral 3 8B (Reasoning)Mistral47.1%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedOpen
161Ministral 3 8BMistral47.1%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
162Nemotron 3 Nano Omni 30B A3BNVIDIA46.9%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
163Gemini 1.5 FlashGoogle46.3%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
164Mistral Small 3.1Mistral45.4%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
165Gemma 4 E2BGoogle43.3%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
166Gemma 3 27BGoogle42.8%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
167GPT-4o miniOpenAI42.6%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
168Exaone 4.0 1.2BLG AI Research42.4%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
169DeepSeek-V2.5DeepSeek42.3%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
170Qwen2.5 Coder 32B InstructAlibaba41.7%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
171Devstral SmallMistral41.4%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
172Claude 3.5 HaikuAnthropic40.8%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
No rank on this tableNemotron 3 Nano 30BNVIDIA39.9%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedOpen
173Claude 3 HaikuAnthropic37.4%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
No rank on this tableMinistral 3 3B (Reasoning)Mistral35.8%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedOpen
174Ministral 3 3BMistral35.8%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
175LFM2.5-1.2B-ThinkingLiquidAI33.9%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
176LFM2.5-1.2B-InstructLiquidAI32.6%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
No rank on this tablePhi-4 Multimodal InstructMicrosoft31.5%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedOpen
No rank on this tableLFM2.5-VL-1.6B-ExtractLiquidAI28.9%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedOpen
177Gemini 1.0 ProGoogle27.7%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedClosed
No rank on this tableLlama 3.1 8BMeta27.0%Carried from an upstream pageArtificial AnalysisOriginal resultNot reportedOpen
178Granite-4.0-H-1BIBM26.3%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
179Granite-4.0-350MIBM26.1%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen
180Granite-4.0-H-350MIBM25.7%Independent run: Artificial AnalysisArtificial AnalysisOriginal resultNot reportedOpen

GPQA Diamond (Vals)

BenchLM mirrors this Vals AI leaderboard for reference only. It is excluded from BenchLM overall and category rankings.

GPQA Diamond (Vals); source configurations remain separate from the canonical benchmark table.
Source rankSource model or configurationVals GPQA Diamond mirror scoreSource setupParameters (B)Open / closed
1Gemini 3.1 Pro PreviewGoogle95.5%high reasoningOriginal resultNot reportedUnknown
2GPT-5.6 SolOpenAI95.2%max reasoningOriginal resultNot reportedClosed
3Grok 4.6xAI94.7%high reasoningOriginal resultNot reportedClosed
4Gemini 3.8 FlashGoogle94.4%high reasoningOriginal resultNot reportedClosed
5Gemini 3.7 FlashGoogle93.9%high reasoningOriginal resultNot reportedClosed
6Qwen3.8 MaxAlibaba93.7%Vals AIOriginal resultNot reportedOpen
7Gemini 3.6 FlashGoogle93.4%high reasoningOriginal resultNot reportedClosed
8Claude Opus 5Anthropic93.4%Vals AIOriginal resultNot reportedClosed
9Claude Fable 5.1Anthropic93.4%Vals AIOriginal resultNot reportedClosed
10Claude Fable 5Anthropic93.2%Vals AIOriginal resultNot reportedClosed
11GPT-5.5OpenAI93.2%xhigh reasoningOriginal resultNot reportedClosed
12Kimi K3Moonshot AI92.9%Vals AIOriginal resultNot reportedOpen
13Grok 4.5xAI92.9%high reasoningOriginal resultNot reportedClosed
14Gemini 3.5 FlashGoogle92.7%high reasoningOriginal resultNot reportedClosed
15MiniMax M3MiniMax92.7%Vals AIOriginal resultNot reportedOpen
16Claude Opus 4.8Anthropic92.4%Vals AIOriginal resultNot reportedClosed
17DeepSeek V4 Pro 0813DeepSeek92.4%max reasoningOriginal resultNot reportedOpen
18GPT-5.6 LunaOpenAI91.7%max reasoningOriginal resultNot reportedClosed
19Gemini 3 Pro PreviewGoogle91.7%high reasoningOriginal resultNot reportedUnknown
20GPT-5.2OpenAI91.7%xhigh reasoningOriginal resultNot reportedClosed
21GPT-5.4OpenAI91.7%xhigh reasoningOriginal resultNot reportedClosed
22Grok 4.3xAI91.4%Vals AIOriginal resultNot reportedClosed
23Muse Spark 1.1Meta91.2%xhigh reasoningOriginal resultNot reportedClosed
24GPT-5.6 TerraOpenAI90.9%xhigh reasoningOriginal resultNot reportedClosed
25Qwen3.7 MaxAlibaba90.2%Vals AIOriginal resultNot reportedClosed
26Claude Opus 4.7Anthropic90.2%Vals AIOriginal resultNot reportedClosed
27DeepSeek V4 Flash 0731DeepSeek89.9%high reasoningOriginal resultNot reportedOpen
28Muse SparkMeta89.6%Vals AIOriginal resultNot reportedClosed
29Claude Opus 4.6 (Adaptive)Anthropic89.6%Vals AIOriginal resultNot reportedClosed
30DeepSeek V4 Pro 0813DeepSeek89.4%max reasoningOriginal resultNot reportedOpen
31Kimi K2.6Moonshot AI89.1%Vals AIOriginal resultNot reportedOpen
32Claude Sonnet 5Anthropic88.9%Vals AIOriginal resultNot reportedClosed
33Qwen3.8-27BAlibaba88.9%xhigh reasoningOriginal resultNot reportedOpen
34Grok 4.20 0309 ReasoningxAI88.6%Vals AIOriginal resultNot reportedUnknown
35Grok 4 0709xAI88.1%Vals AIOriginal resultNot reportedUnknown
36GLM-5.3Z.AI88.1%max reasoningOriginal resultNot reportedOpen
37Gemini 3 Flash PreviewGoogle87.9%high reasoningOriginal resultNot reportedUnknown
38Qwen3.5 Plus ThinkingAlibaba87.4%Vals AIOriginal resultNot reportedUnknown
39Qwen3.6 PlusAlibaba87.4%Vals AIOriginal resultNot reportedClosed
40InklingThinking Machines Lab87.1%0.99 reasoningOriginal resultNot reportedOpen
41GPT-5.1OpenAI86.6%high reasoningOriginal resultNot reportedClosed
42MiniMax M2.7MiniMax86.6%Vals AIOriginal resultNot reportedOpen
43GLM-5.3-FlashZ.AI86.4%max reasoningOriginal resultNot reportedOpen
44Nemotron 3 Ultra 550b A55bNvidia86.1%Vals AIOriginal resultNot reportedUnknown
45Claude Opus 4.5 ThinkingAnthropic85.9%Vals AIOriginal resultNot reportedClosed
46GPT-5OpenAI85.6%high reasoningOriginal resultNot reportedUnknown
47GLM-5.2Z.AI85.6%Vals AIOriginal resultNot reportedOpen
48Claude Sonnet 4.6Anthropic85.6%Vals AIOriginal resultNot reportedClosed
49Grok 4 Fast (Reasoning)xAI85.4%Vals AIOriginal resultNot reportedClosed
50Ling 3.0 Flash 2607Ant84.8%Vals AIOriginal resultNot reportedUnknown
51Qwen3 MaxAlibaba84.8%Vals AIOriginal resultNot reportedClosed
52GLM-5.1Z.AI84.5%Vals AIOriginal resultNot reportedOpen
53Grok 4.1 Fast (Reasoning)xAI84.3%Vals AIOriginal resultNot reportedClosed
54o3OpenAI84.1%high reasoningOriginal resultNot reportedClosed
55Kimi K2.5 ThinkingMoonshot AI84.1%Vals AIOriginal resultNot reportedUnknown
56Gemini 3.5 Flash-LiteGoogle83.8%high reasoningOriginal resultNot reportedClosed
57Inkling-SmallThinking Machines Lab83.6%0.99 reasoningOriginal resultNot reportedOpen
58GLM 5 ThinkingZhipu AI83.3%Vals AIOriginal resultNot reportedUnknown
59GPT-5.4 miniOpenAI83.1%xhigh reasoningOriginal resultNot reportedClosed
60Qwen3.5 FlashAlibaba82.8%Vals AIOriginal resultNot reportedClosed
61MiMo-V2.5-ProXiaomi82.6%Vals AIOriginal resultNot reportedClosed
62MiniMax M2.5MiniMax82.1%Vals AIOriginal resultNot reportedClosed
63Claude Sonnet 4.5 ThinkingAnthropic81.6%Vals AIOriginal resultNot reportedClosed
64Gemini 2.5 Flash Preview 09 2025Google81.6%Vals AIOriginal resultNot reportedUnknown
65MiMo-V2.5Xiaomi81.6%Vals AIOriginal resultNot reportedClosed
66Gemini 3.1 Flash Lite PreviewGoogle81.1%high reasoningOriginal resultNot reportedUnknown
67Gemini 2.5 Pro Exp 03 25Google80.8%Vals AIOriginal resultNot reportedUnknown
68GPT-5 miniOpenAI80.3%high reasoningOriginal resultNot reportedClosed
69DeepSeek V3p2 ThinkingFireworks AI80.3%high reasoningOriginal resultNot reportedUnknown
70GLM-4.7Z.AI80.0%Vals AIOriginal resultNot reportedOpen
71Claude Opus 4.5Anthropic79.5%Vals AIOriginal resultNot reportedClosed
72Qwen3 MaxAlibaba79.5%Vals AIOriginal resultNot reportedClosed
73Grok 3 Mini Fast High ReasoningxAI79.3%high reasoningOriginal resultNot reportedUnknown
74GPT-OSS 120BOpenAI78.5%Vals AIOriginal resultNot reportedOpen
75MiniMax M2.1MiniMax78.5%Vals AIOriginal resultNot reportedUnknown
76Kimi K2 ThinkingMoonshot AI78.5%Vals AIOriginal resultNot reportedUnknown
77Qwen3 Max PreviewAlibaba77.8%Vals AIOriginal resultNot reportedUnknown
78GPT-5.4 nanoOpenAI77.5%high reasoningOriginal resultNot reportedClosed
79Gemini 2.5 Flash Preview 09 2025 ThinkingGoogle76.5%Vals AIOriginal resultNot reportedUnknown
80Claude Opus 4.1 20250805 ThinkingAnthropic76.3%Vals AIOriginal resultNot reportedUnknown
81DeepSeek V3p2Fireworks AI76.3%none reasoningOriginal resultNot reportedUnknown
82o3-miniOpenAI75.5%high reasoningOriginal resultNot reportedClosed
83Claude 3.7 Sonnet ThinkingAnthropic75.3%Vals AIOriginal resultNot reportedClosed
84Claude Sonnet 4 20250514 ThinkingAnthropic75.0%Vals AIOriginal resultNot reportedUnknown
85o4-miniOpenAI74.5%high reasoningOriginal resultNot reportedClosed
86GLM-4.6Z.AI74.5%Vals AIOriginal resultNot reportedOpen
87Grok 3xAI74.2%Vals AIOriginal resultNot reportedUnknown
88o1OpenAI73.2%high reasoningOriginal resultNot reportedClosed
89Grok 3 Mini Fast Low ReasoningxAI73.0%low reasoningOriginal resultNot reportedUnknown
90Claude Haiku 4.5 ThinkingAnthropic72.2%Vals AIOriginal resultNot reportedClosed
91GLM-4.5Z.AI72.2%Vals AIOriginal resultNot reportedClosed
92Claude Opus 4Anthropic71.7%Vals AIOriginal resultNot reportedUnknown
93Moonshotai Kimi K2 InstructTogether AI71.5%Vals AIOriginal resultNot reportedUnknown
94Gemini 2.5 Flash Lite Preview 09 2025 ThinkingGoogle70.2%Vals AIOriginal resultNot reportedUnknown
95Qwen3 235B-A22BAlibaba70.2%Vals AIOriginal resultNot reportedOpen
96Claude Opus 4.1Anthropic70.0%Vals AIOriginal resultNot reportedUnknown
97Llama4 Maverick Instruct BasicFireworks AI69.4%Vals AIOriginal resultNot reportedUnknown
98Claude Sonnet 4Anthropic69.4%Vals AIOriginal resultNot reportedUnknown
99GPT-OSS 20BOpenAI68.9%Vals AIOriginal resultNot reportedOpen
100Mistral Large 2512Mistral AI68.4%Vals AIOriginal resultNot reportedUnknown
101GPT-4.1 miniOpenAI67.9%high reasoningOriginal resultNot reportedClosed
102Claude 3.7 SonnetAnthropic67.4%Vals AIOriginal resultNot reportedClosed
103GPT-4.1OpenAI65.4%high reasoningOriginal resultNot reportedClosed
104Gemini 2.0 Flash 001Google65.2%Vals AIOriginal resultNot reportedUnknown
105Grok 4.1 Fast Non ReasoningxAI65.2%Vals AIOriginal resultNot reportedUnknown
106Gemini 2.5 Flash Lite Preview 09 2025Google64.1%Vals AIOriginal resultNot reportedUnknown
107GPT-5 nanoOpenAI63.4%high reasoningOriginal resultNot reportedClosed
108Langston Nim Nvidia Llama 3.3 Nemotron Super 49b V1 42e84561 ThinkingTogether AI62.4%Vals AIOriginal resultNot reportedUnknown
109Magistral Medium 2509Mistral AI62.4%Vals AIOriginal resultNot reportedUnknown
110Grok 4 Fast Non ReasoningxAI62.1%Vals AIOriginal resultNot reportedUnknown
111DeepSeek V3 0324DeepSeek61.6%Vals AIOriginal resultNot reportedOpen
112Claude 3.5 SonnetAnthropic59.3%Vals AIOriginal resultNot reportedClosed
113MiMo-V2-FlashXiaomi59.3%Vals AIOriginal resultNot reportedOpen
114Gemini 1.5 Pro 002Google58.3%Vals AIOriginal resultNot reportedUnknown
115Magistral Small 2509Mistral AI58.3%Vals AIOriginal resultNot reportedUnknown
116Gemini 2.5 Flash Preview 04 17Google57.6%Vals AIOriginal resultNot reportedUnknown
117Laguna XS.2Poolside55.0%Vals AIOriginal resultNot reportedOpen
118DeepSeek V3DeepSeek54.5%Vals AIOriginal resultNot reportedOpen
119GPT-4oOpenAI53.8%high reasoningOriginal resultNot reportedClosed
120GPT-4.1 nanoOpenAI50.8%high reasoningOriginal resultNot reportedClosed
121Mistral Small 2402Mistral AI50.8%Vals AIOriginal resultNot reportedUnknown
122Grok 2 1212xAI50.8%Vals AIOriginal resultNot reportedUnknown
123GPT-4oOpenAI50.3%high reasoningOriginal resultNot reportedClosed
124Meta Llama Llama 3.3 70B Instruct TurboTogether AI50.0%Vals AIOriginal resultNot reportedUnknown
125Command A 03 2025Cohere48.5%Vals AIOriginal resultNot reportedUnknown
126Mistral Large 2411Mistral AI47.7%Vals AIOriginal resultNot reportedUnknown
127Langston Nim Nvidia Llama 3.3 Nemotron Super 49b V1 42e84561Together AI47.7%Vals AIOriginal resultNot reportedUnknown
128Meta Llama Llama 4 Scout 17B 16E InstructTogether AI47.0%Vals AIOriginal resultNot reportedUnknown
129Gemini 1.5 Flash 002Google46.0%Vals AIOriginal resultNot reportedUnknown
130Mistral Small 2503Mistral AI44.2%Vals AIOriginal resultNot reportedUnknown
131GPT-4o miniOpenAI44.2%high reasoningOriginal resultNot reportedClosed
132Claude 3.5 HaikuAnthropic37.9%Vals AIOriginal resultNot reportedClosed
133Jamba Large 1.6AI21 Labs36.1%Vals AIOriginal resultNot reportedUnknown
134Mistral Medium 3.5Mistral AI34.8%high reasoningOriginal resultNot reportedUnknown
135Jamba Mini 1.6AI21 Labs32.1%Vals AIOriginal resultNot reportedUnknown
136Command R PlusCohere31.1%Vals AIOriginal resultNot reportedUnknown
137GPT-3.5 TurboOpenAI30.6%high reasoningOriginal resultNot reportedUnknown
138Laguna M.1Poolside27.0%Vals AIOriginal resultNot reportedClosed

GPQA Diamond Zero-Shot (Kaggle)

Native proportions are displayed as percentages. Source profiles, task versions, evaluation dates, and symmetric intervals stay attached to each row. Missing results are not zero. How Kaggle Benchmarks reruns tests.

GPQA Diamond Zero-Shot (Kaggle); source configurations remain separate from the canonical benchmark table.
Source rankSource model or configurationAccuracy (%)Source setupParameters (B)Open / closed
1Gemini 4 Carbon97.0%Task version 5; Evaluated 2026-11-03Original resultNot reportedUnknown
2Gemini 3.6 Flash93.4%Task version 5; Evaluated 2026-10-08Original resultNot reportedUnknown
3GPT-5.6 Sol92.9%Task version 5; Evaluated 2026-10-08Original resultNot reportedUnknown
4GPT-6 Astra92.9%Task version 5; Evaluated 2026-10-08Original resultNot reportedUnknown
5Gemini 3.5 Flash91.4%Task version 5; Evaluated 2026-10-08Original resultNot reportedUnknown
6Grok 4.590.9%Task version 5; Evaluated 2026-10-09Original resultNot reportedUnknown
7Claude Opus 590.9%Task version 5; Evaluated 2026-10-09Original resultNot reportedUnknown
8Gemini 3 Flash Preview90.4%Task version 5; Evaluated 2026-10-08Original resultNot reportedUnknown
9GPT-5.6 Terra86.4%Task version 5; Evaluated 2026-10-08Original resultNot reportedUnknown
10Gemma 4 31B84.8%Task version 5; Evaluated 2026-10-07Original resultNot reportedUnknown
11GPT-584.3%Task version 5; Evaluated 2026-10-12Original resultNot reportedUnknown
12GPT-5.6 Luna84.3%Task version 5; Evaluated 2026-10-09Original resultNot reportedUnknown
13Claude Opus 4.884.3%Task version 5; Evaluated 2026-10-09Original resultNot reportedUnknown
14Gemma 4 26B A4B83.2%Task version 5; Evaluated 2026-10-09Original resultNot reportedUnknown
15DeepSeek-R180.8%Task version 5; Evaluated 2026-10-09Original resultNot reportedUnknown
16Gemini 3.5 Flash-Lite74.7%Task version 5; Evaluated 2026-10-07Original resultNot reportedUnknown
17o4 mini71.7%Task version 5; Evaluated 2026-10-12Original resultNot reportedUnknown
18gpt-oss-120b70.7%Task version 5; Evaluated 2026-10-09Original resultNot reportedUnknown
19gpt-oss-20b62.1%Task version 5; Evaluated 2026-10-12Original resultNot reportedUnknown

GPQA Diamond Few-Shot (Kaggle)

Native proportions are displayed as percentages. Source profiles, task versions, evaluation dates, and symmetric intervals stay attached to each row. Missing results are not zero. How Kaggle Benchmarks reruns tests.

GPQA Diamond Few-Shot (Kaggle); source configurations remain separate from the canonical benchmark table.
Source rankSource model or configurationAccuracy (%)Source setupParameters (B)Open / closed
1Gemini 4 Carbon97.4%Task version 5; Evaluated 2026-11-03Original resultNot reportedUnknown
2GPT-6 Astra94.9%Task version 5; Evaluated 2026-10-24Original resultNot reportedUnknown
3Claude Opus 592.9%Task version 5; Evaluated 2026-10-24Original resultNot reportedUnknown
4Gemini 3.6 Flash89.9%Task version 5; Evaluated 2026-10-24Original resultNot reportedUnknown
5Gemma 4 26B A4B83.2%Task version 5; Evaluated 2026-10-24Original resultNot reportedUnknown
6Gemma 4 31B82.8%Task version 5; Evaluated 2026-10-24Original resultNot reportedUnknown
7GPT-5.6 Luna80.8%Task version 5; Evaluated 2026-10-24Original resultNot reportedUnknown
8GPT-5.6 Terra79.3%Task version 5; Evaluated 2026-10-24Original resultNot reportedUnknown

GPQA Diamond Few-Shot (Kaggle, October 20 run)

Native proportions are displayed as percentages. Source profiles, task versions, evaluation dates, and symmetric intervals stay attached to each row. Missing results are not zero. How Kaggle Benchmarks reruns tests.

GPQA Diamond Few-Shot (Kaggle, October 20 run); source configurations remain separate from the canonical benchmark table.
Source rankSource model or configurationAccuracy (%)Source setupParameters (B)Open / closed
1GPT-6 Astra93.9%Task version 4; Evaluated 2026-09-15Original resultNot reportedUnknown
2Grok 4.593.9%Task version 4; Evaluated 2026-07-14Original resultNot reportedUnknown
3Gemini 3 Pro Preview93.4%Task version 4; Evaluated 2025-11-13Original resultNot reportedUnknown
4Gemini 3.5 Flash92.4%Task version 4; Evaluated 2026-06-28Original resultNot reportedUnknown
5GPT-5.6 Sol92.4%Task version 4; Evaluated 2026-07-15Original resultNot reportedUnknown
6Claude Opus 589.9%Task version 4; Evaluated 2026-07-27Original resultNot reportedUnknown
7Gemini 3 Flash Preview89.9%Task version 4; Evaluated 2026-06-28Original resultNot reportedUnknown
8Grok 486.9%Task version 4; Evaluated 2025-09-03Original resultNot reportedUnknown
9Gemini 3.6 Flash86.4%Task version 4; Evaluated 2026-07-22Original resultNot reportedUnknown
10Gemma 4 31B86.4%Task version 4; Evaluation date not reportedOriginal resultNot reportedUnknown
11GPT-5.6 Terra84.3%Task version 4; Evaluated 2026-07-15Original resultNot reportedUnknown
12Gemini 2.5 Pro Preview83.8%Task version 4; Evaluated 2025-06-06Original resultNot reportedUnknown
13GPT-583.3%Task version 4; Evaluated 2025-08-19Original resultNot reportedUnknown
14Claude Opus 4.883.2%Task version 4; Evaluated 2026-06-28Original resultNot reportedUnknown
15GPT-5.6 Luna81.8%Task version 4; Evaluated 2026-07-15Original resultNot reportedUnknown
16DeepSeek-R180.3%Task version 4; Evaluated 2025-06-04Original resultNot reportedUnknown
17o380.3%Task version 4; Evaluated 2025-05-08Original resultNot reportedUnknown
18Gemma 4 26B A4B79.2%Task version 4; Evaluation date not reportedOriginal resultNot reportedUnknown
19o4 mini76.3%Task version 4; Evaluated 2025-05-08Original resultNot reportedUnknown
20o174.2%Task version 4; Evaluated 2025-05-08Original resultNot reportedUnknown
21o3 mini74.2%Task version 4; Evaluated 2025-05-08Original resultNot reportedUnknown
22Claude Opus 4.173.7%Task version 4; Evaluated 2025-08-20Original resultNot reportedUnknown
23Claude Opus 472.7%Task version 4; Evaluated 2025-05-23Original resultNot reportedUnknown
24Gemini 3.5 Flash-Lite72.7%Task version 4; Evaluated 2026-07-22Original resultNot reportedUnknown
25Grok 3 Mini72.2%Task version 4; Evaluated 2025-05-26Original resultNot reportedUnknown
26deepseek-v3.171.2%Task version 4; Evaluated 2025-08-26Original resultNot reportedUnknown
27Grok 370.2%Task version 4; Evaluated 2025-05-26Original resultNot reportedUnknown
28Claude 3.7 Sonnet66.7%Task version 4; Evaluated 2025-05-08Original resultNot reportedUnknown
29gpt-oss-120b66.2%Task version 4; Evaluated 2025-08-19Original resultNot reportedUnknown
30Claude Sonnet 465.7%Task version 4; Evaluated 2025-05-23Original resultNot reportedUnknown
31Gemini 2.0 Flash65.2%Task version 4; Evaluated 2025-05-08Original resultNot reportedUnknown
32GPT-4.164.6%Task version 4; Evaluated 2025-05-08Original resultNot reportedUnknown
33DeepSeek-V362.1%Task version 4; Evaluated 2025-05-08Original resultNot reportedUnknown
34Claude 3.5 Sonnet61.6%Task version 4; Evaluated 2025-05-08Original resultNot reportedUnknown
35Gemini 1.5 Pro60.6%Task version 4; Evaluated 2025-05-08Original resultNot reportedUnknown
36o1 mini60.6%Task version 4; Evaluated 2025-05-08Original resultNot reportedUnknown
37Mistral Large 255.6%Task version 4; Evaluated 2025-05-08Original resultNot reportedUnknown
38Grok 253.0%Task version 4; Evaluated 2025-05-08Original resultNot reportedUnknown
39GPT-4o50.0%Task version 4; Evaluated 2025-05-08Original resultNot reportedUnknown
40Gemini 1.5 Flash46.0%Task version 4; Evaluated 2025-05-08Original resultNot reportedUnknown
41Gemma 3 27B45.5%Task version 4; Evaluated 2025-05-08Original resultNot reportedUnknown
42GPT-4o mini42.9%Task version 4; Evaluated 2025-05-08Original resultNot reportedUnknown
43Claude 3.5 Haiku40.9%Task version 4; Evaluated 2025-05-08Original resultNot reportedUnknown
44Granite 4.0 Small40.9%Task version 4; Evaluated 2025-09-30Original resultNot reportedUnknown
45gpt-oss-20b37.9%Task version 4; Evaluated 2025-08-19Original resultNot reportedUnknown
46Gemma 3 12B35.4%Task version 4; Evaluated 2025-05-08Original resultNot reportedUnknown
47Ministral 8B34.8%Task version 4; Evaluated 2025-05-08Original resultNot reportedUnknown
48Mixtral 8x22B34.8%Task version 4; Evaluated 2025-05-08Original resultNot reportedUnknown
49Codestral33.3%Task version 4; Evaluated 2025-05-08Original resultNot reportedUnknown
50Gemini 1.5 Flash 8B32.3%Task version 4; Evaluated 2025-05-08Original resultNot reportedUnknown
51GPT-3.5 Turbo30.3%Task version 4; Evaluated 2025-05-08Original resultNot reportedUnknown
52Ministral 3B30.3%Task version 4; Evaluated 2025-05-08Original resultNot reportedUnknown
53Gemma 3 4B26.8%Task version 4; Evaluated 2025-05-08Original resultNot reportedUnknown
54Gemini 2.5 Flash Preview25.3%Task version 4; Evaluated 2025-05-23Original resultNot reportedUnknown
55Qwen 3 235B A22B Thinking12.1%Task version 4; Evaluated 2025-08-19Original resultNot reportedUnknown

Among the reported GPQA-D rows, GPT-6 Astra is first at 96.0%. The third row is 0.5 points behind. The broader top-10 range is 2.5 points, so many of the published results sit in a relatively narrow band.

88 models have been evaluated on GPQA-D. The benchmark falls in the Knowledge category. GPQA-D is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.

About GPQA-D

Year

2023

Tasks

Graduate-level science questions

Format

Multiple choice questions

Difficulty

Graduate level

BenchLM stores GPQA-D separately from the standardized GPQA row when providers publish exact chart values that should not overwrite the core weighted benchmark.

Freshness and provenance

Version

GPQA-D 2023

Refresh cadence

Static

Staleness state

Stale

Question availability

Public benchmark set

StaleDisplay only

BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.

Questions

What does GPQA-D measure?

A display-only GPQA Diamond reference from provider comparison charts.

Which model scores highest on GPQA-D?

GPT-6 Astra by OpenAI currently leads with a score of 96.0% on GPQA-D.

How many models are evaluated on GPQA-D?

88 AI models have published results on GPQA-D in the BenchLM catalog.

Last updated: November 15, 2026 · BenchLM version GPQA-D 2023

Know when it’s worth switching models

The model to choose, the cheaper alternative, and the release we would wait on.

Read a sample issue

Join 7,000+ subscribers.

One email each week. Unsubscribe anytime.