MMMU-Pro with Python (MMMU-Pro w/ Python)
We show this table for reference; we do not rank on it.
Tool-augmented MMMU-Pro variant that allows Python assistance during multimodal reasoning.
Benchmark score on MMMU-Pro w/ Python — September 27, 2026
We compile the MMMU-Pro w/ Python rows from provider self-reports. GPT-5.6 Sol leads the table at 84.6%, followed by Kimi K3 (83.4%) and GPT-5.5 (83.2%). We do not use these results to rank models overall.
GPT-5.6 Sol
OpenAI
Kimi K3
Moonshot AI
GPT-5.5
OpenAI
9 modelsMultimodal & GroundedCurrentDisplay onlyUpdated September 27, 2026
Benchmark score table (9 models)
ScoreAmong the reported MMMU-Pro w/ Python rows, GPT-5.6 Sol is first at 84.6%. The third row is 1.4 points behind. The broader top-10 range is 15.1 points, so the table still separates the published systems.
9 models have been evaluated on MMMU-Pro w/ Python. The benchmark falls in the Multimodal & Grounded category. MMMU-Pro w/ Python is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.
About MMMU-Pro w/ Python
Year
2026
Tasks
Multimodal academic reasoning
Format
Image + text question answering with Python
Difficulty
Frontier multimodal
Useful for measuring multimodal reasoning when the model can combine visual understanding with computation.
Freshness and provenance
Version
MMMU-Pro w/ Python 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
Questions
What does MMMU-Pro w/ Python measure?
Tool-augmented MMMU-Pro variant that allows Python assistance during multimodal reasoning.
Which model scores highest on MMMU-Pro w/ Python?
GPT-5.6 Sol by OpenAI currently leads with a score of 84.6% on MMMU-Pro w/ Python.
How many models are evaluated on MMMU-Pro w/ Python?
9 AI models have been evaluated on MMMU-Pro w/ Python on BenchLM.
Compare top models on MMMU-Pro w/ Python
Know when it’s worth switching models
The model to choose, the cheaper alternative, and the release we would wait on.
Read a sample issueJoin 2,000+ readers.
One email each week. Unsubscribe anytime.