Massive Multi-discipline Multimodal Understanding Pro (MMMU-Pro)
A harder multimodal benchmark for frontier models that combines text with images, diagrams, charts, and academic visual reasoning tasks.
Top models on MMMU-Pro — November 13, 2026
As of November 13, 2026, GPT-6.1 Terra leads the MMMU-Pro leaderboard with 85.5% , followed by Kimi K3.1 Pro (84.1%) and Gemini 3.1 Pro (83.9%).
GPT-6.1 Terra
OpenAI
Reported by OpenAIKimi K3.1 Pro
Moonshot AI
Reported by Moonshot AIGemini 3.1 Pro
54 modelsMultimodal & Grounded30% of Multimodal reference weightRefreshingUpdated November 13, 2026
Leaderboard (54 models)
None of the 54 results on this page has a documented run by the benchmark or an independent evaluator: 50 reported by the labs that built the models and 4 reported in another publisher’s document.
| Rank | Model / configuration | Score | Who ran it | Parameters (B) | Open / closed |
|---|---|---|---|---|---|
| 1 | GPT-6.1 TerraOpenAIReported by OpenAI | 85.5% | Reported by OpenAI | Not reported | Closed |
| 2 | Kimi K3.1 ProMoonshot AIReported by Moonshot AI | 84.1% | Reported by Moonshot AI | Not reported | Open |
| 3 | Gemini 3.1 ProGoogleReported by Meta AI (comparison table) | 83.9% | Reported by Meta AI (comparison table) | Not reported | Closed |
| 4 | Gemini 3.5 FlashGoogleReported by Google | 83.6% | Reported by Google | Not reported | Closed |
| 5 | GPT-5.6 SolOpenAIReported by OpenAI | 83% | Reported by OpenAI | Not reported | Closed |
| 6 | Qwen3.8 MaxAlibabaReported by Alibaba | 82.3% | Reported by Alibaba | Not reported | Open |
| 7 | Inkling 2 SmallThinking Machines LabReported by Thinking Machines Lab | 81.6% | Reported by Thinking Machines Lab | Not reported | Closed |
| 8 | Kimi K3Moonshot AIReported by Moonshot AI | 81.6% | Reported by Moonshot AI | Not reported | Open |
| 9 | Seed 2.1 ProByteDanceReported by ByteDance | 81.6% | Reported by ByteDance | Not reported | Closed |
| 10 | GPT-5.5OpenAIReported by OpenAI | 81.2% | Reported by OpenAI | Not reported | Closed |
| 11 | GPT-5.4OpenAIReported by OpenAI | 81.2% | Reported by OpenAI | Not reported | Closed |
| 12 | Gemini 3 ProGoogleReported by Google | 81% | Reported by Google | Not reported | Closed |
| 13 | GPT-5.6 TerraOpenAIReported by OpenAI | 80.7% | Reported by OpenAI | Not reported | Closed |
| 14 | Muse SparkMetaReported by Meta | 80.4% | Reported by Meta | Not reported | Closed |
| 15 | Seed 2.1 TurboByteDanceReported by ByteDance | 80.1% | Reported by ByteDance | Not reported | Closed |
| 16 | GPT-5.2OpenAIReported by OpenAI | 79.5% | Reported by OpenAI | Not reported | Closed |
| 17 | Kimi K2.6Moonshot AIReported by Moonshot AI | 79.4% | Reported by Moonshot AI | Not reported | Open |
| 18 | dots3-note PreviewDots StudioReported by Dots Studio | 79.1% | Reported by Dots Studio | Not reported | Open |
| 19 | Qwen3.7 PlusAlibabaReported by Alibaba | 79% | Reported by Alibaba | Not reported | Closed |
| 20 | Qwen3.5 397BAlibabaReported by Alibaba | 79% | Reported by Alibaba | Not reported | Open |
| 21 | Qwen3.6 PlusAlibabaReported by Alibaba | 78.8% | Reported by Alibaba | Not reported | Closed |
| 22 | Hy4TencentReported by Tencent | 78.6% | Reported by Tencent | Not reported | Pending |
| 23 | Kimi K2.5 (Reasoning)Moonshot AIReported by Moonshot AI | 78.5% | Reported by Moonshot AI | Not reported | Open |
| 24 | Kimi K2.5Moonshot AIReported by Moonshot AI | 78.5% | Reported by Moonshot AI | Not reported | Open |
| 25 | GPT-5.6 LunaOpenAIReported by OpenAI | 78.4% | Reported by OpenAI | Not reported | Closed |
| 26 | MiniMax M3MiniMaxReported by MiniMax | 78.1% | Reported by MiniMax | Not reported | Open |
| 27 | Grok 4.3xAIReported by a third party | 78.1% | Reported by a third party | Not reported | Closed |
| 28 | Pareto 26.9UnbiasedReported by Unbiased | 78% | Reported by Unbiased | Not reported | Closed |
| 29 | MiMo-V2.5XiaomiReported by Xiaomi | 77.9% | Reported by Xiaomi | Not reported | Closed |
| 30 | Claude Opus 4.6AnthropicReported by Anthropic | 77.3% | Reported by Anthropic | Not reported | Closed |
| 31 | Qwen3.5-122B-A10BAlibabaReported by Alibaba | 76.9% | Reported by Alibaba | Not reported | Open |
| 32 | Gemma 4 31BGoogleReported by Google | 76.9% | Reported by Google | Not reported | Open |
| 33 | GPT-5.4 miniOpenAIReported by OpenAI | 76.6% | Reported by OpenAI | Not reported | Closed |
| 34 | Step 5 PreviewStepFunReported by StepFun | 76% | Reported by StepFun | Not reported | Open |
| 35 | Qwen3.6-27BAlibabaReported by Alibaba | 75.8% | Reported by Alibaba | Not reported | Open |
| 36 | Qwen3.6-35B-A3BAlibabaReported by Alibaba | 75.3% | Reported by Alibaba | Not reported | Open |
| 37 | Grok 4.20xAIReported by Meta AI (comparison table) | 75.2% | Reported by Meta AI (comparison table) | Not reported | Closed |
| 38 | Qwen3.5-35B-A3BAlibabaReported by Alibaba | 75.1% | Reported by Alibaba | Not reported | Open |
| 39 | Qwen3.5-27BAlibabaReported by Alibaba | 75% | Reported by Alibaba | Not reported | Open |
| 40 | Inkling-SmallThinking Machines LabReported by Thinking Machines Lab | 74% | Reported by Thinking Machines Lab | Not reported | Open |
| 41 | Muse Glimmer 30BMetaReported by Meta | 74% | Reported by Meta | Not reported | Open |
| 42 | Gemma 4 26B A4BGoogleReported by Google | 73.8% | Reported by Google | Not reported | Open |
| 43 | InklingThinking Machines LabReported by Thinking Machines Lab | 73.5% | Reported by Thinking Machines Lab | Not reported | Open |
| 44 | Interfaze BetaInterfazeReported by Interfaze | 71.1% | Reported by Interfaze | Not reported | Closed |
| 45 | Claude Opus 4.5AnthropicAnother lab’s comparison table | 70.6% | Another lab’s comparison table | Not reported | Closed |
| 46 | Gemma 4 12BGoogleReported by Google | 69.1% | Reported by Google | Not reported | Open |
| 47 | GPT-5.4 nanoOpenAIReported by OpenAI | 66.1% | Reported by OpenAI | Not reported | Closed |
| 48 | Command A+CohereReported by Cohere | 63% | Reported by Cohere | Not reported | Open |
| 49 | Gemma 4 E4BGoogleReported by Google | 52.6% | Reported by Google | Not reported | Open |
| 50 | Qwen2.5-VL-32BAlibabaReported by Alibaba | 49.5% | Reported by Alibaba | Not reported | Open |
| 51 | Mistral Small 3.1MistralReported by Mistral | 49.3% | Reported by Mistral | Not reported | Open |
| 52 | LFM3-VL-2BLiquidAIReported by LiquidAI | 45.7% | Reported by LiquidAI | Not reported | Open |
| 53 | Gemma 4 E2BGoogleReported by Google | 44.2% | Reported by Google | Not reported | Open |
| 54 | LFM2.5-VL-3BLiquidAIReported by LiquidAI | 30.5% | Reported by LiquidAI | Not reported | Open |
- Lab-reported
- Benchmark-run
- Independent
AA-MMMU-Pro
BenchLM stores the Artificial Analysis MMMU-Pro result separately from the core MMMU-Pro lane because Artificial Analysis controls the evaluation configuration.
| Source rank | Source model or configuration | Score | Who ran it | Source setup | Parameters (B) | Open / closed |
|---|---|---|---|---|---|---|
| 1 | Claude Opus 5.5Anthropic | 87.7% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 2 | GPT-6 AstraOpenAI | 86.9% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 3 | GPT-6.1 SolOpenAI | 86.0% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 4 | Gemini 3.8 FlashGoogle | 85.6% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 5 | Gemini 3.7 FlashGoogle | 85.5% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 6 | Claude Opus 5Anthropic | 84.7% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 7 | GPT-6.1 TerraOpenAI | 84.7% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 8 | Gemini 3.5 FlashGoogle | 84.3% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 9 | Kimi K3.1 ProMoonshot AI | 83.9% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 10 | GPT-5.6 SolOpenAI | 83.4% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 11 | Gemini 3.6 FlashGoogle | 83.2% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 12 | GPT-6 SolOpenAI | 82.9% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| No rank on this table | Qwen3.8 Max PreviewAlibaba | 82.8% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Closed |
| No rank on this table | Gemini 3.1 ProGoogle | 82.4% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Closed |
| 13 | Inkling 2 SmallThinking Machines Lab | 81.6% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 14 | Muse Spark OpenMeta | 80.9% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 15 | GPT-5.6 TerraOpenAI | 80.7% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 16 | Kimi K3Moonshot AI | 80.5% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 17 | Qwen3.7 PlusAlibaba | 80.5% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 18 | Muse SparkMeta | 80.5% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 19 | Grok 4.5xAI | 80.4% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 20 | Gemini 3 ProGoogle | 80.2% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 21 | GPT-5.5OpenAI | 79.9% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 22 | GPT-6 LunaOpenAI | 79.7% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| No rank on this table | Kimi K2.6Moonshot AI | 79.4% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| 23 | Apodex 1.1Apodex | 79.2% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| No rank on this table | Apodex 1.1 MiniApodex | 79.2% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| 24 | MiniMax M3.1 FlashMiniMax | 79.1% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 25 | Ling 3.0 Flash VLInclusionAI | 79.0% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 26 | Gemini 3.5 Flash-LiteGoogle | 79.0% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| No rank on this table | Claude Opus 4.7 (Adaptive)Anthropic | 78.8% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Closed |
| 27 | GPT-5.6 LunaOpenAI | 78.6% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 28 | MiniMax M3MiniMax | 78.6% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 29 | Gemini 3 FlashGoogle | 78.6% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 30 | Qwen3.8-Flash-NextAlibaba | 78.6% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 31 | GPT-5.3 CodexOpenAI | 78.5% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| No rank on this table | GPT-5.3-Codex-SparkOpenAI | 78.5% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Closed |
| 32 | GPT-5.4OpenAI | 78.4% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 33 | Grok 4.3xAI | 78.1% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 34 | Qwen3.6 PlusAlibaba | 78.0% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 35 | Claude Sonnet 5Anthropic | 77.3% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| No rank on this table | Qwen3.5 397BAlibaba | 77.3% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| No rank on this table | Qwen3.5 397B (Reasoning)Alibaba | 77.3% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| 36 | DeepSeek V4.1 Flash 1017DeepSeek | 77.0% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 37 | Step 5 PreviewStepFun | 76.4% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| No rank on this table | Claude Opus 4.7Anthropic | 76.4% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Closed |
| 38 | GPT-5.2-CodexOpenAI | 76.3% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 39 | Qwen3.8-27BAlibaba | 76.3% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 40 | GPT-5.1OpenAI | 75.5% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| No rank on this table | Kimi K2.5 (Reasoning)Moonshot AI | 75.4% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| 41 | Kimi K2.5Moonshot AI | 75.4% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| No rank on this table | Claude Opus 4.6 (Adaptive)Anthropic | 75.4% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Closed |
| 42 | Step 3.7 FlashStepFun | 75.3% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 43 | Qwen3.5-122B-A10BAlibaba | 75.0% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 44 | Qwen3.5-27BAlibaba | 75.0% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 45 | Qwen3.6-35B-A3BAlibaba | 75.0% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 46 | Gemini 2.5 ProGoogle | 74.9% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 47 | Qwen3.6-27BAlibaba | 74.6% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 48 | Muse Glimmer 30BMeta | 74.3% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 49 | GPT-5 (medium)OpenAI | 74.3% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| No rank on this table | GPT-5 (high)OpenAI | 74.2% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Closed |
| 50 | Inkling-SmallThinking Machines Lab | 74.0% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 51 | Claude Opus 4.5 ThinkingAnthropic | 74.0% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 52 | InklingThinking Machines Lab | 73.5% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 53 | Gemma 4 31BGoogle | 73.4% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 54 | GPT-5.4 miniOpenAI | 73.3% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 55 | MiMo-V2.6-FlashXiaomi | 73.1% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 56 | GLM-5V-TurboZ.AI | 72.8% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 57 | Qwen3.5-35B-A3BAlibaba | 72.7% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 58 | Claude Opus 4.6Anthropic | 72.5% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 59 | GPT-5.1-CodexOpenAI | 72.5% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| No rank on this table | GPT-5.1-Codex-MaxOpenAI | 72.5% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Closed |
| 60 | Claude Opus 4.5Anthropic | 71.2% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 61 | Claude Sonnet 4.6Anthropic | 70.6% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 62 | o3OpenAI | 70.1% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 63 | GPT-5 miniOpenAI | 70.1% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 64 | MiMo-V2-OmniXiaomi | 69.9% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 65 | Gemma 4 12BGoogle | 69.7% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 66 | Gemma 4 26B A4BGoogle | 69.2% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 67 | o4-miniOpenAI | 69.2% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 68 | Grok 4xAI | 68.8% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 69 | Claude 4.1 Opus ThinkingAnthropic | 67.9% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 70 | Gemini 2.5 FlashGoogle | 65.5% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 71 | GPT-5.4 nanoOpenAI | 65.4% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 72 | Qwen3.5-4BAlibaba | 65.4% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 73 | Mistral Medium 3.5 128BMistral | 64.9% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 74 | Grok 4.1 Fast (Reasoning)xAI | 63.3% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 75 | Command A+Cohere | 63.2% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 76 | Claude 4 SonnetAnthropic | 62.4% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 77 | Llama 4 MaverickMeta | 62.1% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 78 | Grok 4 Fast (Reasoning)xAI | 61.8% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 79 | GPT-4.1OpenAI | 61.2% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 80 | GPT-5 nanoOpenAI | 61.0% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| No rank on this table | Qwen3-Omni-30B-A3B-ThinkingAlibaba | 60.2% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| 81 | Claude 3.7 SonnetAnthropic | 60.1% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 82 | GPT-4.1 miniOpenAI | 58.7% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 83 | Mistral Small 4Mistral | 56.8% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| No rank on this table | Mistral Small 4 (Reasoning)Mistral | 56.8% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| 84 | Mistral Large 3Mistral | 55.7% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 85 | Qwen3-Omni-30B-A3B-InstructAlibaba | 55.5% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 86 | Gemini 1.5 ProGoogle | 55.0% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 87 | Gemini 2.5 Flash-LiteGoogle | 54.0% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 88 | Nemotron 3 Nano Omni 30B A3BNVIDIA | 53.2% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 89 | Mistral Medium 3Mistral | 53.0% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 90 | Llama 4 ScoutMeta | 52.9% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 91 | Gemma 4 E4BGoogle | 51.4% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| No rank on this table | Ministral 3 14B (Reasoning)Mistral | 49.8% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| 92 | Ministral 3 14BMistral | 49.8% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 93 | Grok 4.1 FastxAI | 48.4% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 94 | Gemini 1.5 FlashGoogle | 48.4% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 95 | Gemma 3 27BGoogle | 48.0% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| No rank on this table | Ministral 3 8B (Reasoning)Mistral | 46.0% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| 96 | Ministral 3 8BMistral | 46.0% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 97 | Claude 3.5 HaikuAnthropic | 45.6% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 98 | Gemma 4 E2BGoogle | 44.6% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 99 | Nova ProAmazon | 44.3% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 100 | GPT-4o miniOpenAI | 41.5% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| 101 | GPT-4.1 nanoOpenAI | 40.1% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| No rank on this table | Ministral 3 3B (Reasoning)Mistral | 38.1% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| 102 | Ministral 3 3BMistral | 38.1% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Open |
| 103 | Claude 3 HaikuAnthropic | 30.8% | Independent run: Artificial Analysis | Artificial AnalysisOriginal result | Not reported | Closed |
| No rank on this table | LFM2.5-VL-1.6B-ExtractLiquidAI | 26.5% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
| No rank on this table | Phi-4 Multimodal InstructMicrosoft | 14.5% | Carried from an upstream page | Artificial AnalysisOriginal result | Not reported | Open |
According to BenchLM.ai, GPT-6.1 Terra leads the MMMU-Pro benchmark with a score of 85.5%, followed by Kimi K3.1 Pro (84.1%) and Gemini 3.1 Pro (83.9%). The top models are clustered within 1.6 points, suggesting this benchmark is nearing saturation for frontier models.
54 models have been evaluated on MMMU-Pro. The benchmark falls in the Multimodal & Grounded category. BenchAlign v5.8 gives MMMU-Pro 30% of the Multimodal reference weight, so it moves the Multimodal leaderboard. Reference weights are relative weights in the calibrated model, not fixed shares of a score.
About MMMU-Pro
Year
2024
Tasks
Multimodal academic reasoning
Format
Image + text question answering
Difficulty
Frontier multimodal
MMMU-Pro extends the original MMMU setup with more difficult multimodal questions and stronger separation at the top end of the model market.
Freshness and provenance
Version
MMMU-Pro 2024
Refresh cadence
Annual
Staleness state
Refreshing
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
Questions
What does MMMU-Pro measure?
A harder multimodal benchmark for frontier models that combines text with images, diagrams, charts, and academic visual reasoning tasks.
Which model scores highest on MMMU-Pro?
GPT-6.1 Terra by OpenAI currently leads with a score of 85.5% on MMMU-Pro.
How many models are evaluated on MMMU-Pro?
54 AI models have published results on MMMU-Pro in the BenchLM catalog.
Know when it’s worth switching models
The model to choose, the cheaper alternative, and the release we would wait on.
Read a sample issueJoin 7,000+ subscribers.
One email each week. Unsubscribe anytime.