benchlm.ai

GPT-5 (medium) vs Llama 4 Behemoth

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

GPT-5 (medium) wins overall with a score of 70 vs 39 (31 point difference).GPT-5 (medium) wins 4 out of 4 categories.

GPT-5 (medium)

CreatorOpenAI
TypeProprietary
Context128K
Score70

Llama 4 Behemoth

CreatorMeta
TypeOpen Weight
Context32K
Score39

Knowledge

GPT-5 (medium)

GPT-5 (medium)

88

Llama 4 Behemoth

45.8

91
MMLU
48
89
GPQA
47
87
SuperGPQA
45
85
OpenBookQA
43

Coding

GPT-5 (medium)

GPT-5 (medium)

83

Llama 4 Behemoth

40

83
HumanEval
40

Mathematics

GPT-5 (medium)

GPT-5 (medium)

92

Llama 4 Behemoth

47

93
AIME 2023
48
95
AIME 2024
50
94
AIME 2025
49
89
HMMT Feb 2023
44
91
HMMT Feb 2024
46
90
HMMT Feb 2025
45
92
BRUMO 2025
47

Reasoning

GPT-5 (medium)

GPT-5 (medium)

86

Llama 4 Behemoth

45

87
SimpleQA
46
85
MuSR
44

Frequently Asked Questions

Which is better, GPT-5 (medium) or Llama 4 Behemoth?

GPT-5 (medium) scores higher overall with 70 vs 39, a difference of 31 points across all benchmarks.

Which is better for knowledge tasks, GPT-5 (medium) or Llama 4 Behemoth?

GPT-5 (medium) leads in knowledge tasks with an average score of 88 vs 45.8.

Which is better for coding, GPT-5 (medium) or Llama 4 Behemoth?

GPT-5 (medium) leads in coding with an average score of 83 vs 40.

Which is better for math, GPT-5 (medium) or Llama 4 Behemoth?

GPT-5 (medium) leads in math with an average score of 92 vs 47.

Which is better for reasoning, GPT-5 (medium) or Llama 4 Behemoth?

GPT-5 (medium) leads in reasoning with an average score of 86 vs 45.

Related Comparisons

GPT-5 (medium) vs GPT-5.4GPT-5 (medium) vs Gemini 3.1 ProGPT-5 (medium) vs Claude Opus 4.6GPT-5 (medium) vs GPT-5.3 CodexGPT-5 (medium) vs Grok 4.1GPT-5 (medium) vs GPT-5.2