Head-to-head comparison across 0benchmark categories. Overall scores shown here use BenchLM's provisional ranking lane.
GPT-5.4 mini
71
Grok Code Fast 1
40
Benchmark data for GPT-5.4 mini and Grok Code Fast 1 is coming soon on BenchLM.
GPT-5.4 mini
Grok Code Fast 1
$0.75 / $4.5
$0.2 / $1.5
201 t/s
172 t/s
3.85s
2.81s
400K
256K
Benchmark data for GPT-5.4 mini and Grok Code Fast 1 is coming soon on BenchLM.
BenchLM has partial data for these models, but not enough overlapping benchmark coverage to produce a fair score-level comparison yet.
GPT-5.4 mini is priced at $0.75 input / $4.50 output per 1M tokens, versus $0.20 input / $1.50 output per 1M tokens for Grok Code Fast 1. GPT-5.4 mini has the larger context window at 400K, compared with 256K for Grok Code Fast 1.
Not fully yet. BenchLM is tracking both models, but the sourced benchmark breakdown for this comparison is still coming soon.
BenchLM only shows category winners and benchmark-level calls when we have sourced results that can be compared fairly. For these models, the public benchmark coverage is not complete enough yet.
GPT-5.4 mini: $0.75 input / $4.50 output per 1M tokens Grok Code Fast 1: $0.20 input / $1.50 output per 1M tokens Both model pages still include creator, context window, reasoning mode, and other metadata while benchmark coverage fills in.
For engineers, researchers, and the plain curious — a weekly brief on new models, ranking shifts, and pricing changes.
Free. No spam. Unsubscribe anytime.