Head-to-head comparison across 0benchmark categories. Overall scores shown here use BenchLM's provisional ranking lane.
Grok 4
63
Llama 3.1 405B
41
Benchmark data for Grok 4 and Llama 3.1 405B is coming soon on BenchLM.
Grok 4
Llama 3.1 405B
$null / $null
$0 / $0
54 t/s
29 t/s
15.60s
2.19s
128K
128K
Benchmark data for Grok 4 and Llama 3.1 405B is coming soon on BenchLM.
BenchLM has partial data for these models, but not enough overlapping benchmark coverage to produce a fair score-level comparison yet.
Not fully yet. BenchLM is tracking both models, but the sourced benchmark breakdown for this comparison is still coming soon.
BenchLM only shows category winners and benchmark-level calls when we have sourced results that can be compared fairly. For these models, the public benchmark coverage is not complete enough yet.
Grok 4: Pricing unavailable Llama 3.1 405B: $0.00 input / $0.00 output per 1M tokens Both model pages still include creator, context window, reasoning mode, and other metadata while benchmark coverage fills in.
For engineers, researchers, and the plain curious — a weekly brief on new models, ranking shifts, and pricing changes.
Free. No spam. Unsubscribe anytime.