Qwen2.5-1M Benchmark Scores & Performance

Benchmark analysis of Qwen2.5-1M by Alibaba across 14 tests.

Creator

Alibaba

Source Type

Open Weight

Reasoning

Non-Reasoning

Context Window

1M

Overall Score

66#29 of 88

Knowledge Benchmarks

MMLU
84
GPQA
83
SuperGPQA
81
OpenBookQA
79

Coding Benchmarks

HumanEval
76

Mathematics Benchmarks

AIME 2023
85
AIME 2024
87
AIME 2025
86
HMMT Feb 2023
81
HMMT Feb 2024
83
HMMT Feb 2025
82
BRUMO 2025
84

Reasoning Benchmarks

SimpleQA
81
MuSR
79

Frequently Asked Questions

How does Qwen2.5-1M perform overall in AI benchmarks?

Qwen2.5-1M ranks #29 out of 88 models with an overall score of 66. It is created by Alibaba and features a 1M context window.

Is Qwen2.5-1M good for knowledge and understanding?

Qwen2.5-1M ranks #29 out of 88 models in knowledge and understanding benchmarks with an average score of 81.8. There are stronger options in this category.

Is Qwen2.5-1M good for coding and programming?

Qwen2.5-1M ranks #30 out of 88 models in coding and programming benchmarks with an average score of 76. There are stronger options in this category.

Is Qwen2.5-1M good for mathematics?

Qwen2.5-1M ranks #29 out of 88 models in mathematics benchmarks with an average score of 84. There are stronger options in this category.

Is Qwen2.5-1M good for reasoning and logic?

Qwen2.5-1M ranks #29 out of 88 models in reasoning and logic benchmarks with an average score of 80. There are stronger options in this category.

Is Qwen2.5-1M open source?

Yes, Qwen2.5-1M is an open weight model created by Alibaba, meaning it can be downloaded and run locally or fine-tuned for specific use cases.

What is the context window size of Qwen2.5-1M?

Qwen2.5-1M has a context window of 1M tokens, which determines how much text it can process in a single interaction.