benchlm.ai

GPT-5 (medium) vs Llama 3.1 405B

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

GPT-5 (medium) wins overall with a score of 70 vs 58 (12 point difference).GPT-5 (medium) wins 4 out of 4 categories.

GPT-5 (medium)

CreatorOpenAI
TypeProprietary
Context128K
Score70

Llama 3.1 405B

CreatorMeta
TypeOpen Weight
Context128K
Score58

Knowledge

GPT-5 (medium)

GPT-5 (medium)

88

Llama 3.1 405B

68.5

91
MMLU
70
89
GPQA
70
87
SuperGPQA
68
85
OpenBookQA
66

Coding

GPT-5 (medium)

GPT-5 (medium)

83

Llama 3.1 405B

62

83
HumanEval
62

Mathematics

GPT-5 (medium)

GPT-5 (medium)

92

Llama 3.1 405B

69

93
AIME 2023
70
95
AIME 2024
72
94
AIME 2025
71
89
HMMT Feb 2023
66
91
HMMT Feb 2024
68
90
HMMT Feb 2025
67
92
BRUMO 2025
69

Reasoning

GPT-5 (medium)

GPT-5 (medium)

86

Llama 3.1 405B

67

87
SimpleQA
68
85
MuSR
66

Frequently Asked Questions

Which is better, GPT-5 (medium) or Llama 3.1 405B?

GPT-5 (medium) scores higher overall with 70 vs 58, a difference of 12 points across all benchmarks.

Which is better for knowledge tasks, GPT-5 (medium) or Llama 3.1 405B?

GPT-5 (medium) leads in knowledge tasks with an average score of 88 vs 68.5.

Which is better for coding, GPT-5 (medium) or Llama 3.1 405B?

GPT-5 (medium) leads in coding with an average score of 83 vs 62.

Which is better for math, GPT-5 (medium) or Llama 3.1 405B?

GPT-5 (medium) leads in math with an average score of 92 vs 69.

Which is better for reasoning, GPT-5 (medium) or Llama 3.1 405B?

GPT-5 (medium) leads in reasoning with an average score of 86 vs 67.

Related Comparisons

GPT-5 (medium) vs GPT-5.4GPT-5 (medium) vs Gemini 3.1 ProGPT-5 (medium) vs Claude Opus 4.6GPT-5 (medium) vs GPT-5.3 CodexGPT-5 (medium) vs Grok 4.1GPT-5 (medium) vs GPT-5.2