Head-to-head comparison across 0benchmark categories. Overall scores shown here use BenchLM's provisional ranking lane.
GPT-5.1
79
GPT-5.4 Pro
91
Benchmark data for GPT-5.1 and GPT-5.4 Pro is coming soon on BenchLM.
GPT-5.1
GPT-5.4 Pro
$1.25 / $10
$30 / $180
111 t/s
74 t/s
57.47s
151.79s
200K
1.05M
Benchmark data for GPT-5.1 and GPT-5.4 Pro is coming soon on BenchLM.
BenchLM has partial data for these models, but not enough overlapping benchmark coverage to produce a fair score-level comparison yet.
GPT-5.4 Pro is priced at $30.00 input / $180.00 output per 1M tokens, versus $1.25 input / $10.00 output per 1M tokens for GPT-5.1. GPT-5.4 Pro has the larger context window at 1.05M, compared with 200K for GPT-5.1.
Not fully yet. BenchLM is tracking both models, but the sourced benchmark breakdown for this comparison is still coming soon.
BenchLM only shows category winners and benchmark-level calls when we have sourced results that can be compared fairly. For these models, the public benchmark coverage is not complete enough yet.
GPT-5.1: $1.25 input / $10.00 output per 1M tokens GPT-5.4 Pro: $30.00 input / $180.00 output per 1M tokens Both model pages still include creator, context window, reasoning mode, and other metadata while benchmark coverage fills in.
For engineers, researchers, and the plain curious — a weekly brief on new models, ranking shifts, and pricing changes.
Free. No spam. Unsubscribe anytime.