Vals AI hosted MMLU-Pro view with subject-level task splits.
BenchLM mirrors the public Vals AI Vals MMLU-Pro mirror leaderboard captured from vals.ai and updated by Vals on Thu, 18 Jun 2026 20:17:36 GMT. The snapshot preserves overall scores, uncertainty, latency, cost-per-test metadata, and task-level scores where Vals publishes them.
Vals MMLU-Pro mirror is display only on BenchLM. Vals proprietary or Vals-hosted aggregate views are useful context, but BenchLM does not use them as weighted ranking inputs or as a replacement for benchmark-native source records.
Year
2026
Tasks
MMLU-Pro subject splits
Format
Accuracy score
Difficulty
Professional academic reasoning
BenchLM keeps this Vals-hosted MMLU-Pro table separate from canonical MMLU-Pro source records.
Version
Vals MMLU-Pro mirror 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
Vals AI hosted MMLU-Pro view with subject-level task splits.
No models have been evaluated on Vals MMLU-Pro mirror yet.
0 AI models are included in BenchLM's mirrored Vals MMLU-Pro mirror snapshot, based on the public leaderboard captured on Thu, 18 Jun 2026 20:17:36 GMT.
For engineers, researchers, and the plain curious — a weekly brief on new models, ranking shifts, and pricing changes.
Free. No spam. Unsubscribe anytime.