benchlm.ai

GPT-OSS 20B vs Llama 4 Behemoth

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Llama 4 Behemoth wins overall with a score of 39 vs 22 (17 point difference).Llama 4 Behemoth wins 4 out of 4 categories.

GPT-OSS 20B

CreatorOpenAI
TypeOpen Weight
Context128K
Score22

Llama 4 Behemoth

CreatorMeta
TypeOpen Weight
Context32K
Score39

Knowledge

Llama 4 Behemoth

GPT-OSS 20B

28.8

Llama 4 Behemoth

45.8

31
MMLU
48
30
GPQA
47
28
SuperGPQA
45
26
OpenBookQA
43

Coding

Llama 4 Behemoth

GPT-OSS 20B

23

Llama 4 Behemoth

40

23
HumanEval
40

Mathematics

Llama 4 Behemoth

GPT-OSS 20B

30

Llama 4 Behemoth

47

31
AIME 2023
48
33
AIME 2024
50
32
AIME 2025
49
27
HMMT Feb 2023
44
29
HMMT Feb 2024
46
28
HMMT Feb 2025
45
30
BRUMO 2025
47

Reasoning

Llama 4 Behemoth

GPT-OSS 20B

28

Llama 4 Behemoth

45

29
SimpleQA
46
27
MuSR
44

Frequently Asked Questions

Which is better, GPT-OSS 20B or Llama 4 Behemoth?

Llama 4 Behemoth scores higher overall with 39 vs 22, a difference of 17 points across all benchmarks.

Which is better for knowledge tasks, GPT-OSS 20B or Llama 4 Behemoth?

Llama 4 Behemoth leads in knowledge tasks with an average score of 45.8 vs 28.8.

Which is better for coding, GPT-OSS 20B or Llama 4 Behemoth?

Llama 4 Behemoth leads in coding with an average score of 40 vs 23.

Which is better for math, GPT-OSS 20B or Llama 4 Behemoth?

Llama 4 Behemoth leads in math with an average score of 47 vs 30.

Which is better for reasoning, GPT-OSS 20B or Llama 4 Behemoth?

Llama 4 Behemoth leads in reasoning with an average score of 45 vs 28.

Related Comparisons

GPT-OSS 20B vs GPT-5.4GPT-OSS 20B vs Gemini 3.1 ProGPT-OSS 20B vs Claude Opus 4.6GPT-OSS 20B vs GPT-5.3 CodexGPT-OSS 20B vs Grok 4.1GPT-OSS 20B vs GPT-5.2