Agentic
Like-for-like- Claude Opus 4.6
- 73.0
- GPT-5.4
- 77.2
- Weighted basis
- 3 vs 3 rows
- Reading
- GPT-5.4 leads
Five or fewer confirmed AI changes, with original sources, on mornings when something changed.A free source-linked morning brief.
See the free Radar BriefUpdated September 3, 2026. Public scores include evidence status and uncertainty. They are not guarantees for a specific workload.
Decision reading
GPT-5.4 has the higher public score estimate, 72.89 versus 67.98, but the 90% score intervals overlap. Treat that as a lead, not a settled winner.
25 results are shared. Category rows based on different benchmark sets are marked directional and do not name a winner.
Recommendations appear only when a shared evidence basis or an explicit operating constraint supports the call. Secondary and unsupported use cases stay disclosed below the initial list.
Tool use, computer use, and multi-step task completion
GPT-5.4
GPT-5.4 leads on the same 3 weighted benchmark rows.
Confidence: stronger
Prompts that approach the documented context limit
GPT-5.4
GPT-5.4 has the larger documented context window.
Confidence: documented
1K fresh input + 500 output tokens
GPT-5.4
GPT-5.4 has the lower estimated token cost for this stated workload. Costs use the listed standard API rates.
Confidence: listed-rates
200K cached + 20K fresh input + 10K output tokens
GPT-5.4
GPT-5.4 has the lower estimated token cost for this stated workload. Claude Opus 4.6 has no published cached-input rate, so cached tokens use its listed input rate.
Confidence: rate-fallback
50K fresh input + 3K output tokens
GPT-5.4
GPT-5.4 has the lower estimated token cost for this stated workload. Costs use the listed standard API rates.
Confidence: listed-rates
Code generation, repair, and software-engineering tasks
Not enough matched evidence
The category averages use different weighted benchmark sets, so they are directional rather than like-for-like.
Confidence: limited
Shared results can support a head-to-head reading. Results present for only one model describe coverage, not superiority.
3 categories use different evidence sets. Those rows remain visible for coverage context but do not name a winner.
Each row states whether both averages use the same weighted benchmark set. Directional and not-comparable rows remain visible, but they never receive a winner in this template.
| Category | Claude Opus 4.6 | GPT-5.4 | Weighted basis | Reading |
|---|---|---|---|---|
| Agentic | 73.0 | 77.2 | Like-for-like3 vs 3 rows | GPT-5.4 leads |
| Math | 36.3 | 42.5 | Like-for-like2 vs 2 rows | GPT-5.4 leads |
| Coding | 68.1 | 57.7 | Directional only3 vs 1 rows | Directional only |
| Knowledge | 69.1 | 57.6 | Directional only4 vs 2 rows | Directional only |
| Multimodal | 77.3 | 73.2 | Directional only1 vs 3 rows | Directional only |
| Reasoning | Not measured | 74.0 | Not comparable0 vs 1 rows | Not comparable |
| Multilingual | Not measured | Not measured | Not comparable0 vs 0 rows | Not comparable |
| Instruction following | Not measured | Not measured | Not comparable0 vs 0 rows | Not comparable |
Only shared public evidence is shown. Sparse evidence stays a ruled list rather than being closed into a radar shape.
Too few matched category axes support a radar. The ruled list below shows only shared benchmark results; positions use each benchmark’s normalized display scale when available.
Terminal-Bench 2.0
Agentic
FrontierMath v2 (Tiers 1-3)
Math
SWE-bench Pro
Coding
FrontierMath v2 (Tier 4)
Math
MMMU-Pro
Multimodal
Three fixed token mixes turn per-token rates into comparable decisions. Each scenario states context fit and whether cached input had to fall back to the published list-input rate.
1K fresh input + 500 output tokens
GPT-5.4 has the lower modeled cost
Costs use the listed standard API rates.
50K fresh input + 3K output tokens
GPT-5.4 has the lower modeled cost
Costs use the listed standard API rates.
200K cached + 20K fresh input + 10K output tokens
GPT-5.4 has the lower modeled cost
Claude Opus 4.6 has no published cached-input rate, so cached tokens use its listed input rate.
Sourced differences are shown directly. Missing facts stay explicit instead of being inferred from a model name or family.
Maximum documented context; output-token limits may be lower.
Claude Opus 4.6
1M
GPT-5.4
1.05M
OpenAI pricingClaude Opus 4.6
Not sourced
GPT-5.4
gpt-5.4
OpenAI pricingA missing cached-input rate falls back to the listed input rate only in the stated workload estimate.
Claude Opus 4.6
Not published
GPT-5.4
$0.25 per 1M cached input tokens
OpenAI pricingClaude Opus 4.6
Not sourced
GPT-5.4
Not sourced
Claude Opus 4.6
Not sourced
GPT-5.4
Not sourced
Claude Opus 4.6
Not sourced
GPT-5.4
Not sourced
Claude Opus 4.6
Non-Reasoning
GPT-5.4
Reasoning
Claude Opus 4.6
Proprietary
GPT-5.4
Proprietary
Claude Opus 4.6
Proprietary
GPT-5.4
Proprietary
Claude Opus 4.6
2026-02-01
GPT-5.4
2026-03-05
Run the same representative tasks against both endpoints before changing production traffic.
The full public result ledger is available for audit without forcing a wide desktop table onto a phone.
Terminal-Bench 2.0
GPT-5.4 leads this result
BrowseComp
Claude Opus 4.6 leads this result
OSWorld-Verified
GPT-5.4 leads this result
Claw-Eval
Shared sourceClaude Opus 4.6 leads this result
DeepSearchQA
Shared sourceClaude Opus 4.6 leads this result
CyberGym
GPT-5.4 leads this result
Gert Labs
Shared sourceGPT-5.4 leads this result
ResearchClawBench
Shared sourceClaude Opus 4.6 leads this result
JobBench
Shared sourceGPT-5.4 leads this result
MCP Atlas
Not directly comparable
Toolathlon
Not directly comparable
τ²-bench results
Not directly comparable
ExploitGym
Not directly comparable
SWE-bench Verified
Not directly comparable
SWE-bench Verified*
Not directly comparable
LiveCodeBench Pro
Shared sourceGPT-5.4 leads this result
SWE-bench Pro
GPT-5.4 leads this result
SWE-Rebench
Not directly comparable
React Native Evals
Shared sourceGPT-5.4 leads this result
Vibe Code Bench
Shared sourceGPT-5.4 leads this result
FrontierCode 1.1 Main
Not directly comparable
GPQA
GPT-5.4 leads this result
GPQA-D
GPT-5.4 leads this result
SuperGPQA
Not directly comparable
MMLU-Pro
Not directly comparable
MMLU-Pro (Arcee)
Not directly comparable
HLE
Claude Opus 4.6 leads this result
HLE w/o tools
Claude Opus 4.6 leads this result
HealthBench Hard
Shared sourceGPT-5.4 leads this result
MedXpertQA (Text)
Shared sourceGPT-5.4 leads this result
HealthBench Professional
Not directly comparable
AIME25 (Arcee)
Not directly comparable
FrontierMath v2 (Tiers 1-3)
Shared sourceGPT-5.4 leads this result
FrontierMath v2 (Tier 4)
Shared sourceGPT-5.4 leads this result
MMMU-Pro
GPT-5.4 leads this result
ERQA
Shared sourceGPT-5.4 leads this result
ScreenSpot Pro
Shared sourceGPT-5.4 leads this result
MedXpertQA (MM)
Shared sourceGPT-5.4 leads this result
OfficeQA Pro
Not directly comparable
MMMU-Pro w/ Python
Not directly comparable
CharXiv
Not directly comparable
SimpleVQA
Not directly comparable
ZeroBench
Not directly comparable
GPT-5.4 has the higher public score estimate, 72.89 versus 67.98, but the 90% score intervals overlap. The higher estimate is not a decisive winner because the uncertainty ranges overlap.
The current coding averages use different weighted benchmark sets, so BenchLM does not name a winner from them. Read the shared benchmark rows directly and test the models on the same task set.
GPT-5.4 leads the like-for-like agentic tasks comparison across 3 shared weighted benchmark rows.
For the stated presets, chat costs $0.0175 on Claude Opus 4.6 and $0.01 on GPT-5.4; repository review costs $0.325 and $0.17; the cache-heavy agent loop costs $1.35 and $0.25. Claude Opus 4.6 has no published cached-input rate, so cached tokens use its listed input rate.
GPT-5.4 has the larger documented context window: 1.05M, compared with 1M.
Last updated September 3, 2026
One weekly email when material rank, price, or benchmark evidence changes make this matchup worth revisiting.
Read a sample issueJoin 2,000+ readers.