Head-to-head comparison across 3benchmark categories. Overall scores shown here use BenchLM's provisional ranking lane.
Claude Opus 4.8
93
GPT-5.4 Pro
91
Verified leaderboard positions: Claude Opus 4.8 #3 · GPT-5.4 Pro unranked
Pick Claude Opus 4.8 if you want the stronger benchmark profile. GPT-5.4 Pro only becomes the better choice if multimodal & grounded is the priority or you need the larger 1.05M context window.
Agentic
+9.2 difference
Knowledge
+21.1 difference
Multimodal
+17.9 difference
Claude Opus 4.8
GPT-5.4 Pro
$5 / $25
$30 / $180
N/A
74 t/s
N/A
151.79s
1M
1.05M
Pick Claude Opus 4.8 if you want the stronger benchmark profile. GPT-5.4 Pro only becomes the better choice if multimodal & grounded is the priority or you need the larger 1.05M context window.
Claude Opus 4.8 has the cleaner provisional overall profile here, landing at 93 versus 91. It is a real lead, but still close enough that category-level strengths matter more than the headline number.
Claude Opus 4.8's sharpest advantage is in knowledge, where it averages 70.1 against 49. The single biggest benchmark swing on the page is BrowseComp, 84.3% to 89.3%. GPT-5.4 Pro does hit back in multimodal & grounded, so the answer changes if that is the part of the workload you care about most.
GPT-5.4 Pro is also the more expensive model on tokens at $30.00 input / $180.00 output per 1M tokens, versus $5.00 input / $25.00 output per 1M tokens for Claude Opus 4.8. That is roughly 7.2x on output cost alone. GPT-5.4 Pro gives you the larger context window at 1.05M, compared with 1M for Claude Opus 4.8.
Claude Opus 4.8 is ahead on BenchLM's provisional leaderboard, 93 to 91. The biggest single separator in this matchup is BrowseComp, where the scores are 84.3% and 89.3%.
Claude Opus 4.8 has the edge for knowledge tasks in this comparison, averaging 70.1 versus 49. Inside this category, HLE w/o tools is the benchmark that creates the most daylight between them.
GPT-5.4 Pro has the edge for agentic tasks in this comparison, averaging 89.3 versus 80.1. Inside this category, BrowseComp is the benchmark that creates the most daylight between them.
GPT-5.4 Pro has the edge for multimodal and grounded tasks in this comparison, averaging 94 versus 76.1. Claude Opus 4.8 stays close enough that the answer can still flip depending on your workload.
For engineers, researchers, and the plain curious — a weekly brief on new models, ranking shifts, and pricing changes.
Free. No spam. Unsubscribe anytime.