Head-to-head comparison across 0benchmark categories. Overall scores shown here use BenchLM's provisional ranking lane.
Claude 3 Haiku
23
Grok 4.1 Fast
69
Benchmark data for Claude 3 Haiku and Grok 4.1 Fast is coming soon on BenchLM.
Claude 3 Haiku
Grok 4.1 Fast
$0.25 / $1.25
$0.2 / $0.5
138 t/s
138 t/s
1.16s
0.54s
200K
1M
Benchmark data for Claude 3 Haiku and Grok 4.1 Fast is coming soon on BenchLM.
BenchLM has partial data for these models, but not enough overlapping benchmark coverage to produce a fair score-level comparison yet.
Claude 3 Haiku is priced at $0.25 input / $1.25 output per 1M tokens, versus $0.20 input / $0.50 output per 1M tokens for Grok 4.1 Fast. Grok 4.1 Fast has the larger context window at 1M, compared with 200K for Claude 3 Haiku.
Not fully yet. BenchLM is tracking both models, but the sourced benchmark breakdown for this comparison is still coming soon.
BenchLM only shows category winners and benchmark-level calls when we have sourced results that can be compared fairly. For these models, the public benchmark coverage is not complete enough yet.
Claude 3 Haiku: $0.25 input / $1.25 output per 1M tokens Grok 4.1 Fast: $0.20 input / $0.50 output per 1M tokens Both model pages still include creator, context window, reasoning mode, and other metadata while benchmark coverage fills in.
For engineers, researchers, and the plain curious — a weekly brief on new models, ranking shifts, and pricing changes.
Free. No spam. Unsubscribe anytime.