benchlm.ai

Claude 3 Haiku vs Qwen2.5-VL-32B

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Claude 3 Haiku wins overall with a score of 46 vs 34 (12 point difference).Claude 3 Haiku wins 4 out of 4 categories.

Claude 3 Haiku

CreatorAnthropic
TypeProprietary
Context200K
Score46

Qwen2.5-VL-32B

CreatorAlibaba
TypeOpen Weight
Context32K
Score34

Knowledge

Claude 3 Haiku

Claude 3 Haiku

54.5

Qwen2.5-VL-32B

40.8

56
MMLU
43
56
GPQA
42
54
SuperGPQA
40
52
OpenBookQA
38

Coding

Claude 3 Haiku

Claude 3 Haiku

48

Qwen2.5-VL-32B

35

48
HumanEval
35

Mathematics

Claude 3 Haiku

Claude 3 Haiku

55

Qwen2.5-VL-32B

42

56
AIME 2023
43
58
AIME 2024
45
57
AIME 2025
44
52
HMMT Feb 2023
39
54
HMMT Feb 2024
41
53
HMMT Feb 2025
40
55
BRUMO 2025
42

Reasoning

Claude 3 Haiku

Claude 3 Haiku

53

Qwen2.5-VL-32B

40

54
SimpleQA
41
52
MuSR
39

Frequently Asked Questions

Which is better, Claude 3 Haiku or Qwen2.5-VL-32B?

Claude 3 Haiku scores higher overall with 46 vs 34, a difference of 12 points across all benchmarks.

Which is better for knowledge tasks, Claude 3 Haiku or Qwen2.5-VL-32B?

Claude 3 Haiku leads in knowledge tasks with an average score of 54.5 vs 40.8.

Which is better for coding, Claude 3 Haiku or Qwen2.5-VL-32B?

Claude 3 Haiku leads in coding with an average score of 48 vs 35.

Which is better for math, Claude 3 Haiku or Qwen2.5-VL-32B?

Claude 3 Haiku leads in math with an average score of 55 vs 42.

Which is better for reasoning, Claude 3 Haiku or Qwen2.5-VL-32B?

Claude 3 Haiku leads in reasoning with an average score of 53 vs 40.

Related Comparisons

Claude 3 Haiku vs GPT-5.4Claude 3 Haiku vs Gemini 3.1 ProClaude 3 Haiku vs Claude Opus 4.6Claude 3 Haiku vs GPT-5.3 CodexClaude 3 Haiku vs Grok 4.1Claude 3 Haiku vs GPT-5.2