benchlm.ai

Claude 3 Haiku vs Kimi K2.5

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Kimi K2.5 wins overall with a score of 62 vs 46 (16 point difference).Kimi K2.5 wins 4 out of 4 categories.

Claude 3 Haiku

CreatorAnthropic
TypeProprietary
Context200K
Score46

Kimi K2.5

CreatorMoonshot AI
TypeOpen Weight
Context128K
Score62

Knowledge

Kimi K2.5

Claude 3 Haiku

54.5

Kimi K2.5

74.8

56
MMLU
77
56
GPQA
76
54
SuperGPQA
74
52
OpenBookQA
72

Coding

Kimi K2.5

Claude 3 Haiku

48

Kimi K2.5

69

48
HumanEval
69

Mathematics

Kimi K2.5

Claude 3 Haiku

55

Kimi K2.5

76

56
AIME 2023
77
58
AIME 2024
79
57
AIME 2025
78
52
HMMT Feb 2023
73
54
HMMT Feb 2024
75
53
HMMT Feb 2025
74
55
BRUMO 2025
76

Reasoning

Kimi K2.5

Claude 3 Haiku

53

Kimi K2.5

73

54
SimpleQA
74
52
MuSR
72

Frequently Asked Questions

Which is better, Claude 3 Haiku or Kimi K2.5?

Kimi K2.5 scores higher overall with 62 vs 46, a difference of 16 points across all benchmarks.

Which is better for knowledge tasks, Claude 3 Haiku or Kimi K2.5?

Kimi K2.5 leads in knowledge tasks with an average score of 74.8 vs 54.5.

Which is better for coding, Claude 3 Haiku or Kimi K2.5?

Kimi K2.5 leads in coding with an average score of 69 vs 48.

Which is better for math, Claude 3 Haiku or Kimi K2.5?

Kimi K2.5 leads in math with an average score of 76 vs 55.

Which is better for reasoning, Claude 3 Haiku or Kimi K2.5?

Kimi K2.5 leads in reasoning with an average score of 73 vs 53.

Related Comparisons

Claude 3 Haiku vs GPT-5.4Claude 3 Haiku vs Gemini 3.1 ProClaude 3 Haiku vs Claude Opus 4.6Claude 3 Haiku vs GPT-5.3 CodexClaude 3 Haiku vs Grok 4.1Claude 3 Haiku vs GPT-5.2