Skip to main content

Model comparison

Inkling vs Qwen2.5 Coder 32B Instruct

Data verified

Head-to-head evidence from 4 shared benchmark results across 2 categories. Overall scores shown here use the public BenchAlign v5 ranking lane.

Thinking Machines Lab
72/100
Margin
37.4pts
← winning
0 category wins0 category wins

Verified leaderboard positions: Inkling #17; Qwen2.5 Coder 32B Instruct unranked

BenchAlign evidence: Inkling not scored; Qwen2.5 Coder 32B Instruct supported. Intervals and evidence labels describe ranking uncertainty, not a guarantee for a specific workload.

Evidence parity. Inkling and Qwen2.5 Coder 32B Instruct share 4 comparable benchmark results. 0 of 8 categories are comparable. 28 results are unique to Inkling; 0 to Qwen2.5 Coder 32B Instruct.

Updated July 16, 2026
Shared results
4
Inkling only
28
Qwen2.5 Coder 32B Instruct only
0
Comparable categories
0 / 8

Benchmark data for Inkling and Qwen2.5 Coder 32B Instruct is coming soon on BenchLM.

Confidence note. This is a partial-evidence comparison with 4 shared benchmark results across 2 evidence categories; 0 of 8 categories currently have scoreable aggregates for both models. Treat the verdict as directional until coverage is more balanced.

Why this result

BenchLM has partial data for these models, but not enough overlapping benchmark coverage to produce a fair score-level comparison yet.

Inkling is priced at $1.87 input / $4.68 output per 1M tokens, versus $0.00 input / $0.00 output per 1M tokens for Qwen2.5 Coder 32B Instruct. Inkling has the larger context window at 1M, compared with 128K for Qwen2.5 Coder 32B Instruct.

Category breakdown

Exact category averages are shown below. Not measured means BenchLM does not have enough sourced public coverage for that model and category.

Category scores and score margins for Inkling and Qwen2.5 Coder 32B Instruct
CategoryInklingΔQwen2.5 Coder 32B Instruct
AgenticInkling69.4MarginNo overlapQwen2.5 Coder 32B InstructNot measured
CodingInkling68.6MarginNo overlapQwen2.5 Coder 32B InstructNot measured
KnowledgeInkling51.7MarginNo overlapQwen2.5 Coder 32B InstructNot measured
MathInkling97.1MarginNo overlapQwen2.5 Coder 32B InstructNot measured
MultimodalInkling76.5MarginNo overlapQwen2.5 Coder 32B InstructNot measured
Inst. FollowingInkling79.8MarginNo overlapQwen2.5 Coder 32B InstructNot measured

Operational comparison

Runtime and commercial metrics are compared only when both models have a complete sourced value.

MetricInklingQwen2.5 Coder 32B InstructComparison
Input / output priceUSD per 1M tokensInkling$1.87 input / $4.68 outputQwen2.5 Coder 32B Instruct$0 input / $0 outputQwen2.5 Coder 32B Instruct has the lower combined listed price.
Generation speedtokens per secondInklingNot availableQwen2.5 Coder 32B InstructNot availableA complete speed comparison is not available.
First-answer latencyseconds to first tokenInklingNot availableQwen2.5 Coder 32B InstructNot availableA complete latency comparison is not available.
Context windowmaximum listed tokensInkling1MQwen2.5 Coder 32B Instruct128KInkling lists the larger context window.

Benchmark Deep Dive

Agentic
BenchmarkInklingQwen2.5 Coder 32B InstructResult
Terminal-Bench 2.0Source 63.8%Not comparable
BrowseCompSource 77.1%Not comparable
MCP AtlasSource 74.1%Not comparable
Design Arena Agentic Web DevSource 1258Not comparable
AA Agentic IndexSource 32.3%Not comparable
GDPval-AASource 36.9%Not comparable
GDPval-AASource 1239Not comparable
AA BriefcaseSource 836Not comparable
AA Tau3 BankingSource 23.7%Not comparable
Coding
BenchmarkInklingQwen2.5 Coder 32B InstructResult
SWE-bench VerifiedSource 77.6%Not comparable
SWE-bench ProSource 54.3%Not comparable
Terminal-Bench 2.0Source 63.8%Not comparable
AA Coding IndexSource 52.1%Not comparable
AA-SciCodeSource 46.1%27.1%Inkling leads
Reasoning
BenchmarkInklingQwen2.5 Coder 32B InstructResult
AA-LCRSource 63.3%Not comparable
CritPtSource 5.4%Not comparable
Knowledge
BenchmarkInklingQwen2.5 Coder 32B InstructResult
GPQASource 87.9%Not comparable
GPQA-DSource 87.9%Not comparable
HLESource 46%Not comparable
HLE w/o toolsSource 30%Not comparable
Artificial Analysis Intelligence IndexSource 40.7%7.1%Inkling leads
AA-GPQA DiamondSource 87.2%41.7%Inkling leads
AA-HLESource 29.7%3.8%Inkling leads
AA-Omniscience IndexSource 2.1%Not comparable
AA-Omniscience AccuracySource 40.0%Not comparable
AA-Omniscience Hallucination RateSource 63.1%Not comparable
Math
BenchmarkInklingQwen2.5 Coder 32B InstructResult
AIME26Source 97.1%Not comparable
Multimodal
BenchmarkInklingQwen2.5 Coder 32B InstructResult
MMMU-ProSource 73.5%Not comparable
CharXivSource 82%Not comparable
CharXiv w/o toolsSource 78.1%Not comparable
AA-MMMU-ProSource 73.5%Not comparable
Inst. Following
BenchmarkInklingQwen2.5 Coder 32B InstructResult
IFBenchSource 79.8%Not comparable
Frequently Asked Questions (3)

Can I compare Inkling and Qwen2.5 Coder 32B Instruct on BenchLM yet?

Not fully yet. BenchLM is tracking both models, but the sourced benchmark breakdown for this comparison is still coming soon.

Why does this comparison show “coming soon”?

BenchLM only shows category winners and benchmark-level calls when we have sourced results that can be compared fairly. For these models, the public benchmark coverage is not complete enough yet.

What data is available for Inkling and Qwen2.5 Coder 32B Instruct today?

Inkling: $1.87 input / $4.68 output per 1M tokens Qwen2.5 Coder 32B Instruct: $0.00 input / $0.00 output per 1M tokens Both model pages still include creator, context window, reasoning mode, and other metadata while benchmark coverage fills in.

Related Comparisons

Last updated: July 16, 2026

The AI models change fast. We track them for you.

A weekly brief for engineers and researchers covering new models, ranking shifts, and pricing changes.

Free. No spam. Unsubscribe anytime.