Head-to-head comparison across 0benchmark categories. Overall scores shown here use BenchLM's provisional ranking lane.
Kimi K2
41
Llama 3.1 405B
41
Benchmark data for Kimi K2 and Llama 3.1 405B is coming soon on BenchLM.
Kimi K2
Llama 3.1 405B
$0.6 / $2.5
$0 / $0
43 t/s
29 t/s
1.51s
2.19s
128K
128K
Benchmark data for Kimi K2 and Llama 3.1 405B is coming soon on BenchLM.
BenchLM has partial data for these models, but not enough overlapping benchmark coverage to produce a fair score-level comparison yet.
Kimi K2 is priced at $0.60 input / $2.50 output per 1M tokens, versus $0.00 input / $0.00 output per 1M tokens for Llama 3.1 405B.
Not fully yet. BenchLM is tracking both models, but the sourced benchmark breakdown for this comparison is still coming soon.
BenchLM only shows category winners and benchmark-level calls when we have sourced results that can be compared fairly. For these models, the public benchmark coverage is not complete enough yet.
Kimi K2: $0.60 input / $2.50 output per 1M tokens Llama 3.1 405B: $0.00 input / $0.00 output per 1M tokens Both model pages still include creator, context window, reasoning mode, and other metadata while benchmark coverage fills in.
For engineers, researchers, and the plain curious — a weekly brief on new models, ranking shifts, and pricing changes.
Free. No spam. Unsubscribe anytime.