Model comparison

GLM-4.7 vs o3

Data verified July 20, 2026

Head-to-head evidence from 14 shared benchmark results across 7 categories. Overall scores shown here use the public BenchAlign v5 ranking lane.

GLM-4.7

Z.AI

61.16/100

Margin

13.3pts

← winning

OpenAI

47.89/100

0 category wins1 category wins

Public leaderboard positions: GLM-4.7 #42 (Supported); o3 #131 (Supported). Intervals and evidence labels describe ranking uncertainty, not a guarantee for a specific workload.

Evidence parity. GLM-4.7 and o3 share 14 comparable benchmark results. 1 of 8 categories are comparable. 16 results are unique to GLM-4.7; 2 to o3.

Updated July 20, 2026

Shared results: 14
GLM-4.7 only: 16
o3 only: 2
Comparable categories: 1 / 8

Pick GLM-4.7 if you want the stronger benchmark profile. o3 only becomes the better choice if mathematics is the priority.

Confidence note. This is a partial-evidence comparison with 14 shared benchmark results across 7 evidence categories; 1 of 8 categories currently have scoreable aggregates for both models. Treat the verdict as directional until coverage is more balanced.

Why this result

GLM-4.7 is clearly ahead on the BenchAlign aggregate, 61.16 to 47.89. The gap is large enough that you do not need to squint at the spreadsheet to see the difference.

o3 is also the more expensive model on tokens at $2.00 input / $8.00 output per 1M tokens, versus $0.00 input / $0.00 output per 1M tokens for GLM-4.7. That is roughly Infinityx on output cost alone.

Category breakdown

Exact category averages are shown below. Not measured means BenchLM does not have enough sourced public coverage for that model and category.

Category scores and score margins for GLM-4.7 and o3
Category	GLM-4.7	Δ	o3
Math	GLM-4.71.8	Margin→ 12.7	o314.5
Agentic	GLM-4.745.7	MarginNo overlap	o3Not measured
Coding	GLM-4.775.4	MarginNo overlap	o3Not measured
Knowledge	GLM-4.751.8	MarginNo overlap	o3Not measured

Decisive benchmark drivers

The largest measured benchmark gaps in this matchup, with exact reported values.

A · GLM-4.7B · o3

FrontierMath v2 (Tiers 1-3)
Math
Source ↗
A 2.439%B 18.685%
Winner: o3Δ 16.2
FrontierMath v2 (Tiers 1-3): GLM-4.7 scored 2.439%; o3 scored 18.685%. o3 wins this benchmark.
FrontierMath v2 (Tier 4)
Math
Source ↗
A 0.000%B 2.083%
Winner: o3Δ 2.1
FrontierMath v2 (Tier 4): GLM-4.7 scored 0.000%; o3 scored 2.083%. o3 wins this benchmark.

Operational comparison

Runtime and commercial metrics are compared only when both models have a complete sourced value.

Metric	GLM-4.7	o3	Comparison
Input / output priceUSD per 1M tokens	GLM-4.7$0 input / $0 output	o3$2 input / $8 output	GLM-4.7 has the lower combined listed price.
Generation speedtokens per second	GLM-4.782 tok/s	o3118 tok/s	o3 has the higher measured throughput.
First-answer latencyseconds to first token	GLM-4.71.10 s	o35.38 s	GLM-4.7 reaches the first token sooner.
Context windowmaximum listed tokens	GLM-4.7200K	o3200K	Listed context windows are equal.

Benchmark Deep Dive

Agentic

8 benchmarks

Benchmark	GLM-4.7	o3	Result
Terminal-Bench 2.0Source	41%	—	Not comparable
BrowseCompSource	52%	—	Not comparable
VITA-BenchSource	15.5%	—	Not comparable
AA Agentic IndexSource	25.4%	—	Not comparable
τ²-bench resultsSource	95.9%	80.7%	GLM-4.7 leads
Gert LabsSource	39.95%	—	Not comparable
GDPval-AASource	33.3%	—	Not comparable
GDPval-AASource	1165	—	Not comparable

Coding

6 benchmarks

Benchmark	GLM-4.7	o3	Result
SWE-bench VerifiedSource	73.8%	—	Not comparable
LiveCodeBenchSource	84.9%	—	Not comparable
SWE-RebenchSource	58.7%	—	Not comparable
AA Coding IndexSource	45.3%	—	Not comparable
AA-SciCodeSource	45.1%	41.0%	GLM-4.7 leads
AA LiveCodeBenchSource	89.4%	—	Not comparable

Reasoning

2 benchmarks

Benchmark	GLM-4.7	o3	Result
AA-LCRSource	64.0%	69.3%	o3 leads
CritPtSource	1.7%	1.1%	GLM-4.7 leads

Knowledge

9 benchmarks

Benchmark	GLM-4.7	o3	Result
GPQASource	85.7%	—	Not comparable
MMLU-ProSource	84.3%	—	Not comparable
HLESource	24.8%	—	Not comparable
Artificial Analysis Intelligence IndexSource	33.7%	30.4%	GLM-4.7 leads
AA-GPQA DiamondSource	85.9%	82.7%	GLM-4.7 leads
AA-HLESource	25.1%	20.0%	GLM-4.7 leads
AA-Omniscience IndexSource	-34.6%	-15.3%	o3 leads
AA-Omniscience AccuracySource	29.3%	38.4%	o3 leads
AA-Omniscience Hallucination RateSource	90.3%	87.1%	o3 leads

Matho3 wins

4 benchmarks

Benchmark	GLM-4.7	o3	Result
AIME 2025Source	95.7%	—	Not comparable
FrontierMath v2 (Tiers 1-3)Source	2.439%	18.685%	o3 leads
FrontierMath v2 (Tier 4)Source	0.000%	2.083%	o3 leads
AA MATH-500Source	—	99.2%	Not comparable

Multimodal

2 benchmarks

Benchmark	GLM-4.7	o3	Result
Design Arena WebsiteSource	1258	1069	GLM-4.7 leads
AA-MMMU-ProSource	—	70.1%	Not comparable

Inst. Following

1 benchmarks

Benchmark	GLM-4.7	o3	Result
AA-IFBenchSource	67.9%	71.4%	o3 leads

Frequently Asked Questions (2)

Which is better, GLM-4.7 or o3?

GLM-4.7 is ahead on BenchLM's BenchAlign leaderboard, 61.16 to 47.89. The biggest single separator in this matchup is FrontierMath v2 (Tiers 1-3), where the scores are 2.439% and 18.685%.

Which is better for math, GLM-4.7 or o3?

o3 has the edge for math in this comparison, averaging 14.5 versus 1.8. Inside this category, FrontierMath v2 (Tiers 1-3) is the benchmark that creates the most daylight between them.

Related Comparisons

Explore More

Z.AI Compare Pricing Methodology Find Your Best LLM Overall Rankings

Last updated: July 20, 2026

Choose a model with this week’s evidence

Join 2,000+ readers for ranking moves, pricing changes, and the claims that still need proof.

One email each week. Unsubscribe anytime.