benchlm.ai

Claude 3 Haiku vs GPT-OSS 20B

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Claude 3 Haiku wins overall with a score of 46 vs 22 (24 point difference).Claude 3 Haiku wins 4 out of 4 categories.

Claude 3 Haiku

CreatorAnthropic
TypeProprietary
Context200K
Score46

GPT-OSS 20B

CreatorOpenAI
TypeOpen Weight
Context128K
Score22

Knowledge

Claude 3 Haiku

Claude 3 Haiku

54.5

GPT-OSS 20B

28.8

56
MMLU
31
56
GPQA
30
54
SuperGPQA
28
52
OpenBookQA
26

Coding

Claude 3 Haiku

Claude 3 Haiku

48

GPT-OSS 20B

23

48
HumanEval
23

Mathematics

Claude 3 Haiku

Claude 3 Haiku

55

GPT-OSS 20B

30

56
AIME 2023
31
58
AIME 2024
33
57
AIME 2025
32
52
HMMT Feb 2023
27
54
HMMT Feb 2024
29
53
HMMT Feb 2025
28
55
BRUMO 2025
30

Reasoning

Claude 3 Haiku

Claude 3 Haiku

53

GPT-OSS 20B

28

54
SimpleQA
29
52
MuSR
27

Frequently Asked Questions

Which is better, Claude 3 Haiku or GPT-OSS 20B?

Claude 3 Haiku scores higher overall with 46 vs 22, a difference of 24 points across all benchmarks.

Which is better for knowledge tasks, Claude 3 Haiku or GPT-OSS 20B?

Claude 3 Haiku leads in knowledge tasks with an average score of 54.5 vs 28.8.

Which is better for coding, Claude 3 Haiku or GPT-OSS 20B?

Claude 3 Haiku leads in coding with an average score of 48 vs 23.

Which is better for math, Claude 3 Haiku or GPT-OSS 20B?

Claude 3 Haiku leads in math with an average score of 55 vs 30.

Which is better for reasoning, Claude 3 Haiku or GPT-OSS 20B?

Claude 3 Haiku leads in reasoning with an average score of 53 vs 28.

Related Comparisons

Claude 3 Haiku vs GPT-5.4Claude 3 Haiku vs Gemini 3.1 ProClaude 3 Haiku vs Claude Opus 4.6Claude 3 Haiku vs GPT-5.3 CodexClaude 3 Haiku vs Grok 4.1Claude 3 Haiku vs GPT-5.2