GPQA Diamond, Vals AI run (GPQA Diamond (Vals))
Vals AI’s independent run of the GPQA Diamond graduate-level science questions.
Data verified 31 confirmed releases in the last 30 daysSee provider release alertsHow BenchLM shows Vals GPQA Diamond mirror
BenchLM mirrors the public Vals AI Vals GPQA Diamond mirror leaderboard captured from https://www.vals.ai/benchmarks/gpqa and updated by Vals on September 1, 2026. The snapshot preserves overall scores, uncertainty, latency, cost-per-test metadata, and task-level scores where Vals publishes them.
Vals GPQA Diamond mirror is display only on BenchLM. Vals proprietary or Vals-hosted aggregate views are useful context, but BenchLM does not use them as weighted ranking inputs or as a replacement for benchmark-native source records.
Snapshot
Vals GPQA Diamond mirror score on GPQA Diamond (Vals) — September 1, 2026
We mirror the published vals gpqa diamond mirror score view for GPQA Diamond (Vals). Gemini 3.1 Pro Preview leads the public snapshot at 95.5%, followed by GPT-5.6 Sol (95.2%) and Grok 4.6 (94.7%). We do not use these results to rank models overall.
Gemini 3.1 Pro Preview
high reasoning
GPT-5.6 Sol
OpenAI
max reasoning
Grok 4.6
xAI
high reasoning
138 modelsKnowledgeCurrentDisplay onlyUpdated September 1, 2026
Vals GPQA Diamond mirror score table (138 models)
ScoreThe published GPQA Diamond (Vals) snapshot places Gemini 3.1 Pro Preview first at 95.5%. The third row is 0.8 points behind. The broader top-10 range is 2.3 points, so many of the published results sit in a relatively narrow band.
138 models have been evaluated on GPQA Diamond (Vals). The benchmark falls in the Knowledge category. This category carries a 12% weight in BenchLM.ai's overall scoring system. GPQA Diamond (Vals) is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.
About GPQA Diamond (Vals)
Year
2026
Tasks
Graduate-level science questions
Format
Accuracy
Difficulty
Expert reasoning
BenchLM mirrors the Vals AI board on a dedicated key so a provider-run row on the canonical key is never overwritten. Vals publishes per-task accuracy with standard error, latency, and cost for every model it runs. Admitted as independent third-party evidence in methodology v5.5 (2026-09-04).
BenchLM freshness & provenance
Version
GPQA Diamond (Vals) 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
FAQ
What does GPQA Diamond (Vals) measure?
Vals AI’s independent run of the GPQA Diamond graduate-level science questions.
Which model leads the published GPQA Diamond (Vals) snapshot?
Gemini 3.1 Pro Preview currently leads the published GPQA Diamond (Vals) snapshot with 95.5% vals gpqa diamond mirror score. BenchLM shows this benchmark for display only and does not use it in overall rankings.
How many models are evaluated on GPQA Diamond (Vals)?
The September 1, 2026 snapshot contains 138 AI models.
Know when it’s worth switching models
The model to choose, the cheaper alternative, and the release we would wait on.
Read a sample issueJoin 2,000+ readers.
One email each week. Unsubscribe anytime.