GPT-5.4 mini vs Qwen3 235B 2507

Side-by-side benchmark comparison across agentic, coding, multimodal, knowledge, reasoning, and math workflows.

Benchmark data for one or both models is coming soon. This page currently shows metadata and pricing where BenchLM has it, and score-level comparisons will populate as public benchmark results land.

BenchLM does not have sourced benchmark coverage for GPT-5.4 mini yet. This comparison is currently limited to metadata such as context window, reasoning mode, and pricing where available.

GPT-5.4 mini is priced at $0.75 input / $4.50 output per 1M tokens, versus $0.00 input / $0.00 output per 1M tokens for Qwen3 235B 2507. GPT-5.4 mini has the larger context window at 400K, compared with 128K for Qwen3 235B 2507.

Quick Verdict

Benchmark data for GPT-5.4 mini and Qwen3 235B 2507 is coming soon on BenchLM.

Agentic

Coming soon

Benchmark data for this category is coming soon.

Coding

Coming soon

Comparable scores for this category are coming soon. One or both models do not have sourced results here yet.

Coming soon
HumanEval
31%
Coming soon
LiveCodeBench
51.8%

Multimodal & Grounded

Coming soon

Benchmark data for this category is coming soon.

Reasoning

Coming soon

Comparable scores for this category are coming soon. One or both models do not have sourced results here yet.

Coming soon
SimpleQA
54.3%
Coming soon
MuSR
35%

Knowledge

GPT-5.4 mini

GPT-5.4 mini

88

Qwen3 235B 2507

75.9

88%
GPQA
77.5%
Coming soon
MMLU
39%
Coming soon
SuperGPQA
62.6%
Coming soon
OpenBookQA
34%
Coming soon
MMLU-Pro
83%

Instruction Following

Coming soon

Benchmark data for this category is coming soon.

Multilingual

Coming soon

Benchmark data for this category is coming soon.

Mathematics

Coming soon

Comparable scores for this category are coming soon. One or both models do not have sourced results here yet.

Coming soon
AIME 2023
39%
Coming soon
AIME 2024
41%
Coming soon
AIME 2025
70.3%
Coming soon
HMMT Feb 2023
35%
Coming soon
HMMT Feb 2024
37%
Coming soon
HMMT Feb 2025
55.4%
Coming soon
BRUMO 2025
38%

Frequently Asked Questions

Can I compare GPT-5.4 mini and Qwen3 235B 2507 on BenchLM yet?

Not fully yet. BenchLM is tracking both models, but the sourced benchmark breakdown for this comparison is still coming soon.

Why does this comparison show “coming soon”?

BenchLM only shows category winners and benchmark-level calls when we have sourced results that can be compared fairly. For these models, the public benchmark coverage is not complete enough yet.

What data is available for GPT-5.4 mini and Qwen3 235B 2507 today?

GPT-5.4 mini: $0.75 input / $4.50 output per 1M tokens Qwen3 235B 2507: $0.00 input / $0.00 output per 1M tokens Both model pages still include creator, context window, reasoning mode, and other metadata while benchmark coverage fills in.

Last updated: March 17, 2026

Weekly LLM Benchmark Digest

Get notified when new models drop, benchmark scores change, or the leaderboard shifts. One email per week.

Free. No spam. Unsubscribe anytime. We only store derived location metadata for consent routing.