benchlm.ai

GPT-OSS 20B vs Grok 3 [Beta]

Side-by-side benchmark comparison across knowledge, coding, math, and reasoning.

Quick Verdict

Grok 3 [Beta] wins overall with a score of 33 vs 22 (11 point difference).Grok 3 [Beta] wins 4 out of 4 categories.

GPT-OSS 20B

CreatorOpenAI
TypeOpen Weight
Context128K
Score22

Grok 3 [Beta]

CreatorxAI
TypeProprietary
Context128K
Score33

Knowledge

Grok 3 [Beta]

GPT-OSS 20B

28.8

Grok 3 [Beta]

39.8

31
MMLU
42
30
GPQA
41
28
SuperGPQA
39
26
OpenBookQA
37

Coding

Grok 3 [Beta]

GPT-OSS 20B

23

Grok 3 [Beta]

34

23
HumanEval
34

Mathematics

Grok 3 [Beta]

GPT-OSS 20B

30

Grok 3 [Beta]

41

31
AIME 2023
42
33
AIME 2024
44
32
AIME 2025
43
27
HMMT Feb 2023
38
29
HMMT Feb 2024
40
28
HMMT Feb 2025
39
30
BRUMO 2025
41

Reasoning

Grok 3 [Beta]

GPT-OSS 20B

28

Grok 3 [Beta]

39

29
SimpleQA
40
27
MuSR
38

Frequently Asked Questions

Which is better, GPT-OSS 20B or Grok 3 [Beta]?

Grok 3 [Beta] scores higher overall with 33 vs 22, a difference of 11 points across all benchmarks.

Which is better for knowledge tasks, GPT-OSS 20B or Grok 3 [Beta]?

Grok 3 [Beta] leads in knowledge tasks with an average score of 39.8 vs 28.8.

Which is better for coding, GPT-OSS 20B or Grok 3 [Beta]?

Grok 3 [Beta] leads in coding with an average score of 34 vs 23.

Which is better for math, GPT-OSS 20B or Grok 3 [Beta]?

Grok 3 [Beta] leads in math with an average score of 41 vs 30.

Which is better for reasoning, GPT-OSS 20B or Grok 3 [Beta]?

Grok 3 [Beta] leads in reasoning with an average score of 39 vs 28.

Related Comparisons

GPT-OSS 20B vs GPT-5.4GPT-OSS 20B vs Gemini 3.1 ProGPT-OSS 20B vs Claude Opus 4.6GPT-OSS 20B vs GPT-5.3 CodexGPT-OSS 20B vs Grok 4.1GPT-OSS 20B vs GPT-5.2