Model comparison
GPT-5.4 Pro vs Soofi S 30B-A3B
Head-to-head evidence from 0 shared benchmark results across 0 categories. Overall scores shown here use BenchLM's provisional ranking lane.
Evidence parity. GPT-5.4 Pro and Soofi S 30B-A3B share 0 comparable benchmark results. 1 of 8 categories are comparable. 12 results are unique to GPT-5.4 Pro; 8 to Soofi S 30B-A3B.
Updated July 15, 2026- Shared results
- 0
- GPT-5.4 Pro only
- 12
- Soofi S 30B-A3B only
- 8
- Comparable categories
- 1 / 8
Pick GPT-5.4 Pro if you want the stronger benchmark profile. Soofi S 30B-A3B only becomes the better choice if knowledge is the priority or you want the cheaper token bill.
Confidence note. This is a partial-evidence comparison with 0 shared benchmark results across 0 evidence categories; 1 of 8 categories currently have scoreable aggregates for both models. Treat the verdict as directional until coverage is more balanced.
Why this result
GPT-5.4 Pro is clearly ahead on the provisional aggregate, 83 to 45. The gap is large enough that you do not need to squint at the spreadsheet to see the difference.
GPT-5.4 Pro is also the more expensive model on tokens at $30.00 input / $180.00 output per 1M tokens, versus $0.00 input / $0.00 output per 1M tokens for Soofi S 30B-A3B. That is roughly Infinityx on output cost alone. GPT-5.4 Pro is the reasoning model in the pair, while Soofi S 30B-A3B is not. That usually helps on harder chain-of-thought-heavy tests, but it can also mean more latency and more token spend in real use. GPT-5.4 Pro gives you the larger context window at 1.05M, compared with 1M for Soofi S 30B-A3B.
Operational comparison
Runtime and commercial metrics are compared only when both models have a complete sourced value.
| Metric | GPT-5.4 Pro | Soofi S 30B-A3B | Comparison |
|---|---|---|---|
| Input / output priceUSD per 1M tokens | GPT-5.4 Pro$30 input / $180 output | Soofi S 30B-A3B$0 input / $0 output | Soofi S 30B-A3B has the lower combined listed price. |
| Generation speedtokens per second | GPT-5.4 Pro74 tok/s | Soofi S 30B-A3BNot available | A complete speed comparison is not available. |
| First-answer latencyseconds to first token | GPT-5.4 Pro151.79 s | Soofi S 30B-A3BNot available | A complete latency comparison is not available. |
| Context windowmaximum listed tokens | GPT-5.4 Pro1.05M | Soofi S 30B-A3B1M | GPT-5.4 Pro lists the larger context window. |
Benchmark Deep Dive
Agentic1 benchmarks
| Benchmark | GPT-5.4 Pro | Soofi S 30B-A3B | Result |
|---|---|---|---|
| BrowseCompSource | 89.3% | — | Not comparable |
Coding1 benchmarks
| Benchmark | GPT-5.4 Pro | Soofi S 30B-A3B | Result |
|---|---|---|---|
| HumanEvalSource | — | 73.8% | Not comparable |
Reasoning4 benchmarks
KnowledgeSoofi S 30B-A3B wins8 benchmarks
| Benchmark | GPT-5.4 Pro | Soofi S 30B-A3B | Result |
|---|---|---|---|
| HLESource | 58.7% | — | Not comparable |
| FrontierScienceSource | 36.7% | — | Not comparable |
| FrontierScience ResearchSource | 36.7% | — | Not comparable |
| HLE w/o toolsSource | 42.7% | — | Not comparable |
| GPQASource | — | 43.4% | Not comparable |
| GPQA-DSource | — | 43.4% | Not comparable |
| MMLU-ProSource | — | 51.4% | Not comparable |
| AGIEvalSource | — | 66.9% | Not comparable |
Math5 benchmarks
Multimodal1 benchmarks
| Benchmark | GPT-5.4 Pro | Soofi S 30B-A3B | Result |
|---|---|---|---|
| MMMU-ProSource | 94% | — | Not comparable |
Frequently Asked Questions (2)
Which is better, GPT-5.4 Pro or Soofi S 30B-A3B?
GPT-5.4 Pro is ahead on BenchLM's provisional leaderboard, 83 to 45.
Which is better for knowledge tasks, GPT-5.4 Pro or Soofi S 30B-A3B?
Soofi S 30B-A3B has the edge for knowledge tasks in this comparison, averaging 49.9 versus 48.4. GPT-5.4 Pro stays close enough that the answer can still flip depending on your workload.
Related Comparisons
Explore More
The AI models change fast. We track them for you.
A weekly brief for engineers and researchers covering new models, ranking shifts, and pricing changes.
Free. No spam. Unsubscribe anytime.