Vals MGSM (MGSM)
A multilingual benchmark for mathematical questions.
Data verifiedHow BenchLM shows MGSM
BenchLM mirrors the public Vals AI MGSM leaderboard captured from https://www.vals.ai/benchmarks/mgsm and updated by Vals on January 9, 2026. The snapshot preserves overall scores, uncertainty, latency, cost-per-test metadata, and task-level scores where Vals publishes them.
MGSM is display only on BenchLM. Vals proprietary or Vals-hosted aggregate views are useful context, but BenchLM does not use them as weighted ranking inputs or as a replacement for benchmark-native source records.
MGSM score on MGSM — January 9, 2026
BenchLM mirrors the published mgsm score view for MGSM. Claude Opus 4.5 20251101 Thinking leads the public snapshot at 95.20% , followed by Claude Opus 4.5 (94.76%) and Claude Opus 4.1 20250805 Thinking (94.44%). BenchLM does not use these results to rank models overall.
Claude Opus 4.5 20251101 Thinking
Anthropic
anthropic/claude-opus-4-5-20251101-thinking
Claude Opus 4.5
Anthropic
anthropic/claude-opus-4-5-20251101
Claude Opus 4.1 20250805 Thinking
Anthropic
anthropic/claude-opus-4-1-20250805-thinking
The published MGSM snapshot is tightly clustered at the top: Claude Opus 4.5 20251101 Thinking sits at 95.20%, while the third row is only 0.76 points behind. The broader top-10 spread is 1.89 points, so many of the published scores sit in a relatively narrow band.
75 models have been evaluated on MGSM. The benchmark falls in the External benchmark mirrors category. BenchLM tracks this category separately from its weighted global scoring system, so these results are best compared on the dedicated Korean benchmark views. MGSM is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.
About MGSM
Year
2026
Tasks
Multilingual grade-school math questions
Format
Accuracy score
Difficulty
Multilingual mathematical reasoning
BenchLM mirrors the public Vals AI MGSM leaderboard as display-only external evidence. The captured snapshot preserves overall scores, task-level scores where Vals publishes them, uncertainty, latency, and cost-per-test metadata. It is excluded from BenchLM weighted rankings.
BenchLM freshness & provenance
Version
MGSM 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
MGSM score table (75 models)
FAQ
What does MGSM measure?
A multilingual benchmark for mathematical questions.
Which model leads the published MGSM snapshot?
Claude Opus 4.5 20251101 Thinking currently leads the published MGSM snapshot with 95.20% mgsm score. BenchLM shows this benchmark for display only and does not use it in overall rankings.
How many models are evaluated on MGSM?
75 AI models are included in BenchLM's mirrored MGSM snapshot, based on the public leaderboard captured on January 9, 2026.
The AI models change fast. We track them for you.
For engineers, researchers, and the plain curious — a weekly brief on new models, ranking shifts, and pricing changes.
Free. No spam. Unsubscribe anytime.