Head-to-head comparison across 0benchmark categories. Overall scores shown here use BenchLM's provisional ranking lane.
Gemini 1.5 Pro
--
GPT-4o mini
--
Benchmark data for Gemini 1.5 Pro and GPT-4o mini is coming soon on BenchLM.
Gemini 1.5 Pro
GPT-4o mini
$1.25 / $5
$0.15 / $0.6
N/A
33 t/s
N/A
3.16s
2M
128K
Benchmark data for Gemini 1.5 Pro and GPT-4o mini is coming soon on BenchLM.
BenchLM does not have sourced benchmark coverage for Gemini 1.5 Pro and GPT-4o mini yet. This comparison is currently limited to metadata such as context window, reasoning mode, and pricing where available.
Gemini 1.5 Pro is priced at $1.25 input / $5.00 output per 1M tokens, versus $0.15 input / $0.60 output per 1M tokens for GPT-4o mini. Gemini 1.5 Pro has the larger context window at 2M, compared with 128K for GPT-4o mini.
Not fully yet. BenchLM is tracking both models, but the sourced benchmark breakdown for this comparison is still coming soon.
BenchLM only shows category winners and benchmark-level calls when we have sourced results that can be compared fairly. For these models, the public benchmark coverage is not complete enough yet.
Gemini 1.5 Pro: $1.25 input / $5.00 output per 1M tokens GPT-4o mini: $0.15 input / $0.60 output per 1M tokens Both model pages still include creator, context window, reasoning mode, and other metadata while benchmark coverage fills in.
For engineers, researchers, and the plain curious — a weekly brief on new models, ranking shifts, and pricing changes.
Free. No spam. Unsubscribe anytime.