benchlm.ai

Claude Haiku 4.5 vs Mistral 7B v0.3

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Claude Haiku 4.5 wins overall with a score of 57 vs 21 (36 point difference).Claude Haiku 4.5 wins 4 out of 4 categories.

Claude Haiku 4.5

CreatorAnthropic
TypeProprietary
Context200K
Score57

Mistral 7B v0.3

CreatorMistral
TypeOpen Weight
Context32K
Score21

Knowledge

Claude Haiku 4.5

Claude Haiku 4.5

65.8

Mistral 7B v0.3

27.8

68
MMLU
30
67
GPQA
29
65
SuperGPQA
27
63
OpenBookQA
25

Coding

Claude Haiku 4.5

Claude Haiku 4.5

60

Mistral 7B v0.3

22

60
HumanEval
22

Mathematics

Claude Haiku 4.5

Claude Haiku 4.5

67

Mistral 7B v0.3

29

68
AIME 2023
30
70
AIME 2024
32
69
AIME 2025
31
64
HMMT Feb 2023
26
66
HMMT Feb 2024
28
65
HMMT Feb 2025
27
67
BRUMO 2025
29

Reasoning

Claude Haiku 4.5

Claude Haiku 4.5

64

Mistral 7B v0.3

27

65
SimpleQA
28
63
MuSR
26

Frequently Asked Questions

Which is better, Claude Haiku 4.5 or Mistral 7B v0.3?

Claude Haiku 4.5 scores higher overall with 57 vs 21, a difference of 36 points across all benchmarks.

Which is better for knowledge tasks, Claude Haiku 4.5 or Mistral 7B v0.3?

Claude Haiku 4.5 leads in knowledge tasks with an average score of 65.8 vs 27.8.

Which is better for coding, Claude Haiku 4.5 or Mistral 7B v0.3?

Claude Haiku 4.5 leads in coding with an average score of 60 vs 22.

Which is better for math, Claude Haiku 4.5 or Mistral 7B v0.3?

Claude Haiku 4.5 leads in math with an average score of 67 vs 29.

Which is better for reasoning, Claude Haiku 4.5 or Mistral 7B v0.3?

Claude Haiku 4.5 leads in reasoning with an average score of 64 vs 27.

Related Comparisons

Claude Haiku 4.5 vs GPT-5.4Claude Haiku 4.5 vs Gemini 3.1 ProClaude Haiku 4.5 vs Claude Opus 4.6Claude Haiku 4.5 vs GPT-5.3 CodexClaude Haiku 4.5 vs Grok 4.1Claude Haiku 4.5 vs GPT-5.2