Skip to main content
BenchLM
Data

τ²-Bench Tool-Agent-User Evaluation (τ²-bench results)

Data verified

This route is a sourced ledger for published τ²-bench results. Most current rows come from Artificial Analysis's telecom implementation, while named provider rows can use telecom, airline, retail, or aggregate setups.

Top models on τ²-bench results — November 21, 2026

As of November 21, 2026, GLM-5.2 leads the τ²-bench results leaderboard with 99.1% , followed by GPT-5.4 (98.9%) and GLM-4.7-Flash (98.8%).

158 modelsAgentic0% of Agentic reference weightCurrentUpdated November 21, 2026

Leaderboard (158 models)

None of the 158 results on this page has a documented run by the benchmark or an independent evaluator: 15 reported by the labs that built the models, 4 reported in another publisher’s document and 139 carried from an upstream page, where who ran them is not recorded.

τ²-bench results leaderboard
RankModel / configurationScoreParameters (B)Open / closed
1GLM-5.2Z.AICarried from an upstream pageArtificial Analysis τ²-bench
99.1%
Not reportedOpen
2GPT-5.4OpenAIReported by OpenAIτ²-bench Telecom
98.9%
Not reportedClosed
3GLM-4.7-FlashZ.AICarried from an upstream pageArtificial Analysis τ²-bench
98.8%
Not reportedOpen
4Claude Fable 5AnthropicCarried from an upstream pageArtificial Analysis τ²-bench
98.5%
Not reportedClosed
5GLM-5-TurboZ.AICarried from an upstream pageArtificial Analysis τ²-bench
98.5%
Not reportedClosed
6GLM-5V-TurboZ.AICarried from an upstream pageArtificial Analysis τ²-bench
98.5%
Not reportedClosed
7Step 3.7 FlashStepFunCarried from an upstream pageArtificial Analysis τ²-bench
98.5%
Not reportedOpen
8GLM-5Z.AICarried from an upstream pageArtificial Analysis τ²-bench
98.2%
Not reportedOpen
9GPT-5.5OpenAIReported by OpenAIτ²-bench Telecom
98%
Not reportedClosed
10Qwen3.6 PlusAlibabaCarried from an upstream pageArtificial Analysis τ²-bench
97.7%
Not reportedClosed
11GLM-5.1Z.AICarried from an upstream pageArtificial Analysis τ²-bench
97.7%
Not reportedOpen
12Grok 4.3xAIReported by a third partyArtificial Analysis τ²-bench
97.7%
Not reportedClosed
13DeepSeek V4 ProDeepSeekCarried from an upstream pageArtificial Analysis τ²-bench
96.2%
Not reportedOpen
14Kimi K2.6Moonshot AICarried from an upstream pageArtificial Analysis τ²-bench
95.9%
Not reportedOpen
15Kimi K2.5Moonshot AICarried from an upstream pageArtificial Analysis τ²-bench
95.9%
Not reportedOpen
16GLM-4.7Z.AICarried from an upstream pageArtificial Analysis τ²-bench
95.9%
Not reportedOpen
17Qwen 3.6 Max (preview)AlibabaCarried from an upstream pageArtificial Analysis τ²-bench
95.9%
Not reportedClosed
18Gemini 3.1 ProGoogleReported by Meta AI (comparison table)τ²-bench published setup
95.6%
Not reportedClosed
19Qwen3.5 397BAlibabaCarried from an upstream pageArtificial Analysis τ²-bench
95.6%
Not reportedOpen
20Gemini 3.5 FlashGoogleReported by a third partyArtificial Analysis τ²-bench
95.3%
Not reportedClosed
21Qwen3.6-35B-A3BAlibabaCarried from an upstream pageArtificial Analysis τ²-bench
95.3%
Not reportedOpen
22MiniMax M2.5MiniMaxCarried from an upstream pageArtificial Analysis τ²-bench
95.3%
Not reportedClosed
23MiMo-V2-ProXiaomiCarried from an upstream pageArtificial Analysis τ²-bench
95%
Not reportedClosed
24Qwen3.7 MaxAlibabaCarried from an upstream pageArtificial Analysis τ²-bench
94.7%
Not reportedClosed
25Claude Opus 4.8AnthropicCarried from an upstream pageArtificial Analysis τ²-bench
94.4%
Not reportedClosed
26Qwen3.6-27BAlibabaCarried from an upstream pageArtificial Analysis τ²-bench
94.2%
Not reportedOpen
27MiMo-V2.5-ProXiaomiCarried from an upstream pageArtificial Analysis τ²-bench
94.2%
Not reportedClosed
28Mistral Medium 3.5 128BMistralCarried from an upstream pageArtificial Analysis τ²-bench
94.2%
Not reportedOpen
29DeepSeek V4 Pro (High)DeepSeekCarried from an upstream pageArtificial Analysis τ²-bench
94.2%
Not reportedOpen
30Qwen3.5-27BAlibabaCarried from an upstream pageArtificial Analysis τ²-bench
93.9%
Not reportedOpen
31Qwen3.5-122B-A10BAlibabaCarried from an upstream pageArtificial Analysis τ²-bench
93.6%
Not reportedOpen
32GPT-5.4 miniOpenAIReported by OpenAIτ²-bench Telecom
93.4%
Not reportedClosed
33Grok 4.1 Fast (Reasoning)xAICarried from an upstream pageArtificial Analysis τ²-bench
93.3%
Not reportedClosed
34Qwen3.7 PlusAlibabaCarried from an upstream pageArtificial Analysis τ²-bench
93%
Not reportedClosed
35GPT-5.4 nanoOpenAIReported by OpenAIτ²-bench Telecom
92.5%
Not reportedClosed
36GPT-5.2-CodexOpenAICarried from an upstream pageArtificial Analysis τ²-bench
92.1%
Not reportedClosed
37Claude Opus 4.6 (Adaptive)AnthropicCarried from an upstream pageArtificial Analysis τ²-bench
92.1%
Not reportedClosed
38Qwen3.5-4BAlibabaCarried from an upstream pageArtificial Analysis τ²-bench
92.1%
Not reportedOpen
39Muse SparkMetaReported by Metaτ²-bench published setup
91.5%
Not reportedClosed
40MiMo-V2-OmniXiaomiCarried from an upstream pageArtificial Analysis τ²-bench
91.2%
Not reportedClosed
41Kimi K2.7 CodeMoonshot AICarried from an upstream pageArtificial Analysis τ²-bench
90.1%
Not reportedOpen
42Trinity-Large-ThinkingArcee AICarried from an upstream pageArtificial Analysis τ²-bench
90.1%
Not reportedOpen
43Trinity-Large-PreviewArcee AICarried from an upstream pageArtificial Analysis τ²-bench
90.1%
Not reportedOpen
44Claude Opus 4.5 ThinkingAnthropicCarried from an upstream pageArtificial Analysis τ²-bench
89.5%
Not reportedClosed
45Qwen3.5-35B-A3BAlibabaCarried from an upstream pageArtificial Analysis τ²-bench
89.2%
Not reportedOpen
46MiniMax M3MiniMaxCarried from an upstream pageArtificial Analysis τ²-bench
88.9%
Not reportedOpen
47Claude Opus 4.7AnthropicCarried from an upstream pageArtificial Analysis τ²-bench
88.6%
Not reportedClosed
48LFM2.5-8B-A1BLiquidAIReported by LiquidAIτ²-bench Telecom
88.1%
Not reportedOpen
49Step 3.5 FlashStepFunCarried from an upstream pageArtificial Analysis τ²-bench
87.4%
Not reportedOpen
50Gemini 3 ProGoogleCarried from an upstream pageArtificial Analysis τ²-bench
87.1%
Not reportedClosed
51Spark-X2.6-4BSparkLLMReported by SparkLLMτ²-bench published setup
86.9%
Not reportedOpen
52GPT-5.6 TerraOpenAICarried from an upstream pageArtificial Analysis τ²-bench
86.3%
Not reportedClosed
53Claude Opus 4.5AnthropicCarried from an upstream pageArtificial Analysis τ²-bench
86.3%
Not reportedClosed
54Solar Pro 3UpstageCarried from an upstream pageArtificial Analysis τ²-bench
86.3%
Not reportedClosed
55GPT-5.3 CodexOpenAICarried from an upstream pageArtificial Analysis τ²-bench
86%
Not reportedClosed
56Ling 2.6 FlashInclusionAIReported by a third partyArtificial Analysis τ²-bench
86%
Not reportedOpen
57GPT-5.3-Codex-SparkOpenAICarried from an upstream pageArtificial Analysis τ²-bench
86%
Not reportedClosed
58GPT-5.6 SolOpenAICarried from an upstream pageArtificial Analysis τ²-bench
85.1%
Not reportedClosed
59Command A+CohereReported by Cohereτ²-bench Telecom
85%
Not reportedOpen
60GPT-5OpenAICarried from an upstream pageArtificial Analysis τ²-bench
84.8%
Not reportedClosed
61Claude Opus 4.6AnthropicCarried from an upstream pageArtificial Analysis τ²-bench
84.8%
Not reportedClosed
62GPT-5.2OpenAICarried from an upstream pageArtificial Analysis τ²-bench
84.8%
Not reportedClosed
63MiniMax M2.7MiniMaxCarried from an upstream pageArtificial Analysis τ²-bench
84.8%
Not reportedOpen
64MiMo-V2-FlashXiaomiCarried from an upstream pageArtificial Analysis τ²-bench
83.9%
Not reportedOpen
65Nemotron 3 UltraNVIDIACarried from an upstream pageArtificial Analysis τ²-bench
83.3%
Not reportedOpen
66GPT-5.1-CodexOpenAICarried from an upstream pageArtificial Analysis τ²-bench
83%
Not reportedClosed
67GPT-5.1-Codex-MaxOpenAICarried from an upstream pageArtificial Analysis τ²-bench
83%
Not reportedClosed
68GPT-5.1OpenAICarried from an upstream pageArtificial Analysis τ²-bench
81.9%
Not reportedClosed
69o3OpenAICarried from an upstream pageArtificial Analysis τ²-bench
80.7%
Not reportedClosed
70LLaDA2.2-flashInclusionAIReported by InclusionAIτ²-bench published setup
80.3%
Not reportedOpen
71Ternary Bonsai 2 27BPrism MLReported by Prism MLτ²-bench Telecom
80.2%
Not reportedOpen
72Claude Sonnet 4.6AnthropicCarried from an upstream pageArtificial Analysis τ²-bench
79.5%
Not reportedClosed
73DeepSeek V3.2DeepSeekCarried from an upstream pageArtificial Analysis τ²-bench
78.9%
Not reportedOpen
74Agents-A1-4BInternScienceReported by InternScienceτ²-bench published setup
78.2%
Not reportedOpen
75GLM-4.6Z.AICarried from an upstream pageArtificial Analysis τ²-bench
76.9%
Not reportedOpen
76Grok Code Fast 1xAICarried from an upstream pageArtificial Analysis τ²-bench
75.7%
Not reportedClosed
77Grok 4xAICarried from an upstream pageArtificial Analysis τ²-bench
74.9%
Not reportedClosed
78Qwen3 MaxAlibabaCarried from an upstream pageArtificial Analysis τ²-bench
74.3%
Not reportedClosed
79K-ExaoneLG AI ResearchCarried from an upstream pageArtificial Analysis τ²-bench
74.3%
Not reportedClosed
80Claude 4 Opus ThinkingAnthropicCarried from an upstream pageArtificial Analysis τ²-bench
73.4%
Not reportedClosed
81Mercury 2InceptionCarried from an upstream pageArtificial Analysis τ²-bench
70.8%
Not reportedClosed
82GPT-5 miniOpenAICarried from an upstream pageArtificial Analysis τ²-bench
68.4%
Not reportedClosed
83GPT-OSS 120BOpenAICarried from an upstream pageArtificial Analysis τ²-bench
65.8%
Not reportedOpen
84Grok 4 Fast (Reasoning)xAICarried from an upstream pageArtificial Analysis τ²-bench
65.8%
Not reportedClosed
85Grok 4.1 FastxAICarried from an upstream pageArtificial Analysis τ²-bench
63.7%
Not reportedClosed
86o1OpenAICarried from an upstream pageArtificial Analysis τ²-bench
62.6%
Not reportedClosed
87Kimi K2Moonshot AICarried from an upstream pageArtificial Analysis τ²-bench
61.1%
Not reportedClosed
88GPT-OSS 20BOpenAICarried from an upstream pageArtificial Analysis τ²-bench
60.2%
Not reportedOpen
89Gemma 4 31BGoogleCarried from an upstream pageArtificial Analysis τ²-bench
59.9%
Not reportedOpen
90LLaDA2.2-miniInclusionAIReported by InclusionAIτ²-bench published setup
57.5%
Not reportedOpen
91o4-miniOpenAICarried from an upstream pageArtificial Analysis τ²-bench
55.6%
Not reportedClosed
92Nemotron 3.5 Bolt E4B BF16NVIDIAReported by NVIDIAτ²-bench published setup
55.1%
Not reportedOpen
93Claude 3.7 Sonnet ThinkingAnthropicCarried from an upstream pageArtificial Analysis τ²-bench
54.7%
Not reportedClosed
94Gemini 2.5 ProGoogleCarried from an upstream pageArtificial Analysis τ²-bench
54.1%
Not reportedClosed
95GPT-4.1 miniOpenAICarried from an upstream pageArtificial Analysis τ²-bench
52.9%
Not reportedClosed
96Nemotron 3.5 Bolt E4BNVIDIAReported by NVIDIAτ²-bench published setup
52.3%
Not reportedOpen
97Claude 4 SonnetAnthropicCarried from an upstream pageArtificial Analysis τ²-bench
52.3%
Not reportedClosed
98Claude 3.7 SonnetAnthropicCarried from an upstream pageArtificial Analysis τ²-bench
50%
Not reportedClosed
99DeepSeek V3 0324DeepSeekCarried from an upstream pageArtificial Analysis τ²-bench
47.1%
Not reportedOpen
100GPT-4.1OpenAICarried from an upstream pageArtificial Analysis τ²-bench
47.1%
Not reportedClosed
101Sarvam 105BSarvamCarried from an upstream pageArtificial Analysis τ²-bench
46.8%
Not reportedOpen
102GLM-4.5-AirZ.AICarried from an upstream pageArtificial Analysis τ²-bench
46.5%
Not reportedClosed
103Nemotron 3 Nano Omni 30B A3BNVIDIAReported by NVIDIAτ²-bench Telecom
45.3%
Not reportedOpen
104Gemma 4 26B A4BGoogleCarried from an upstream pageArtificial Analysis τ²-bench
43.6%
Not reportedOpen
105Gemini 3 FlashGoogleCarried from an upstream pageArtificial Analysis τ²-bench
43.3%
Not reportedClosed
106Mistral Small 4MistralCarried from an upstream pageArtificial Analysis τ²-bench
41.2%
Not reportedOpen
107North Mini CodeCohereCarried from an upstream pageArtificial Analysis τ²-bench
37.4%
Not reportedOpen
108DeepSeek-R1DeepSeekCarried from an upstream pageArtificial Analysis τ²-bench
36.5%
Not reportedOpen
109GPT-5 nanoOpenAICarried from an upstream pageArtificial Analysis τ²-bench
36.5%
Not reportedClosed
110Gemma 4 12BGoogleCarried from an upstream pageArtificial Analysis τ²-bench
36.3%
Not reportedOpen
111DeepSeek V3.1DeepSeekCarried from an upstream pageArtificial Analysis τ²-bench
34.8%
Not reportedOpen
112Sarvam 30BSarvamCarried from an upstream pageArtificial Analysis τ²-bench
34.5%
Not reportedOpen
113MiniMax M1 80kMiniMaxCarried from an upstream pageArtificial Analysis τ²-bench
34.2%
Not reportedClosed
114Solar Pro 2UpstageCarried from an upstream pageArtificial Analysis τ²-bench
31.9%
Not reportedClosed
115Mistral Large 2MistralCarried from an upstream pageArtificial Analysis τ²-bench
30.7%
Not reportedClosed
116Gemini 2.0 FlashGoogleCarried from an upstream pageArtificial Analysis τ²-bench
29.5%
Not reportedClosed
117o3-miniOpenAICarried from an upstream pageArtificial Analysis τ²-bench
28.7%
Not reportedClosed
118Devstral SmallMistralCarried from an upstream pageArtificial Analysis τ²-bench
28.4%
Not reportedOpen
119Ministral 3 14BMistralCarried from an upstream pageArtificial Analysis τ²-bench
27.2%
Not reportedOpen
120Llama 3.3 70BMetaCarried from an upstream pageArtificial Analysis τ²-bench
26.6%
Not reportedOpen
121Magistral SmallMistralCarried from an upstream pageArtificial Analysis τ²-bench
26.6%
Not reportedOpen
122Ultravox v0.6 Llama 3.3 70BFixie AICarried from an upstream pageArtificial Analysis τ²-bench
26.6%
Not reportedOpen
123Ministral 3 8BMistralCarried from an upstream pageArtificial Analysis τ²-bench
26.6%
Not reportedOpen
124Nemotron 3 Nano 30BNVIDIACarried from an upstream pageArtificial Analysis τ²-bench
25.4%
Not reportedOpen
125GPT-4oOpenAICarried from an upstream pageArtificial Analysis τ²-bench
25.1%
Not reportedClosed
126Mistral Small 3.1MistralCarried from an upstream pageArtificial Analysis τ²-bench
25.1%
Not reportedOpen
127Ministral 3 3BMistralCarried from an upstream pageArtificial Analysis τ²-bench
24.9%
Not reportedOpen
128Mistral Large 3MistralCarried from an upstream pageArtificial Analysis τ²-bench
24.6%
Not reportedOpen
129Claude 3.5 HaikuAnthropicCarried from an upstream pageArtificial Analysis τ²-bench
24.6%
Not reportedClosed
130Mistral Medium 3MistralCarried from an upstream pageArtificial Analysis τ²-bench
24.3%
Not reportedClosed
131Magistral MediumMistralCarried from an upstream pageArtificial Analysis τ²-bench
23.1%
Not reportedClosed
132DeepSeek V3DeepSeekCarried from an upstream pageArtificial Analysis τ²-bench
22.8%
Not reportedOpen
133Llama 3.1 70BMetaCarried from an upstream pageArtificial Analysis τ²-bench
21.6%
Not reportedOpen
134Qwen3-Omni-30B-A3B-ThinkingAlibabaCarried from an upstream pageArtificial Analysis τ²-bench
21.3%
Not reportedOpen
135Claude 3 HaikuAnthropicCarried from an upstream pageArtificial Analysis τ²-bench
21.1%
Not reportedClosed
136Gemma 4 E4BGoogleCarried from an upstream pageArtificial Analysis τ²-bench
20.8%
Not reportedOpen
137Gemma 4 E2BGoogleCarried from an upstream pageArtificial Analysis τ²-bench
20.8%
Not reportedOpen
138Exaone 4.0 1.2BLG AI ResearchCarried from an upstream pageArtificial Analysis τ²-bench
20.5%
Not reportedOpen
139Granite-4.0-H-1BIBMCarried from an upstream pageArtificial Analysis τ²-bench
19.6%
Not reportedOpen
140LFM2.5-1.2B-ThinkingLiquidAICarried from an upstream pageArtificial Analysis τ²-bench
19.6%
Not reportedClosed
141Gemini 2.5 Flash-LiteGoogleCarried from an upstream pageArtificial Analysis τ²-bench
19%
Not reportedClosed
142Llama 3.1 405BMetaCarried from an upstream pageArtificial Analysis τ²-bench
19%
Not reportedOpen
143Llama 4 MaverickMetaCarried from an upstream pageArtificial Analysis τ²-bench
17.8%
Not reportedOpen
144GPT-4.1 nanoOpenAICarried from an upstream pageArtificial Analysis τ²-bench
17.3%
Not reportedClosed
145Qwen3-Omni-30B-A3B-InstructAlibabaCarried from an upstream pageArtificial Analysis τ²-bench
16.4%
Not reportedOpen
146Llama 4 ScoutMetaCarried from an upstream pageArtificial Analysis τ²-bench
15.5%
Not reportedOpen
147Gemini 2.5 FlashGoogleCarried from an upstream pageArtificial Analysis τ²-bench
14.9%
Not reportedClosed
148Granite-4.0-H-350MIBMCarried from an upstream pageArtificial Analysis τ²-bench
14.6%
Not reportedOpen
149Nova ProAmazonCarried from an upstream pageArtificial Analysis τ²-bench
14%
Not reportedClosed
150Granite-4.0-350MIBMCarried from an upstream pageArtificial Analysis τ²-bench
13.2%
Not reportedOpen
151Nemotron Ultra 253BNVIDIACarried from an upstream pageArtificial Analysis τ²-bench
11.4%
Not reportedOpen
152LFM2-24B-A2BLiquidAICarried from an upstream pageArtificial Analysis τ²-bench
11.1%
Not reportedClosed
153LFM2.5-1.2B-InstructLiquidAICarried from an upstream pageArtificial Analysis τ²-bench
10.8%
Not reportedClosed
154Gemma 3 27BGoogleCarried from an upstream pageArtificial Analysis τ²-bench
10.5%
Not reportedOpen
155LFM2.5-VL-1.6B-ExtractLiquidAICarried from an upstream pageArtificial Analysis τ²-bench
8.5%
Not reportedOpen
156Exaone 4.0 32BLG AI ResearchCarried from an upstream pageArtificial Analysis τ²-bench
4.1%
Not reportedOpen
157Phi-4MicrosoftCarried from an upstream pageArtificial Analysis τ²-bench
0%
Not reportedOpen
158Phi-4-reasoningMicrosoftCarried from an upstream pageArtificial Analysis τ²-bench
0%
Not reportedOpen
  • Lab-reported
  • Benchmark-run
  • Independent
What the labels mean

How to read this leaderboard

Editorial review by Glevd · 2026-07-15

Use a row only with its attached source and setup label. Match the domain, task release, agent model, user-simulator model, scaffold, prompts, trial count, and pass^k metric before comparing scores. The sorted table is a source ledger, not a controlled cross-provider ranking.

Operator receipt: 158 sourced rows are currently displayable on this page; the highest published score among these 158 models is GLM-5.2 at 99.1%, which does not establish a market leader.

Honest limit: The page mixes a large third-party telecom snapshot with smaller provider-published slices. Those sources do not use one guaranteed-common harness or reporting policy, and BenchLM did not rerun them. A higher number can reflect a different user model, prompt, domain, task release, or repeat policy.

According to BenchLM.ai, GLM-5.2 leads the τ²-bench results benchmark with a score of 99.1%, followed by GPT-5.4 (98.9%) and GLM-4.7-Flash (98.8%). The top models are clustered within 0.3 points, suggesting this benchmark is nearing saturation for frontier models.

158 models have been evaluated on τ²-bench results. The benchmark falls in the Agentic category. BenchAlign v6.0 gives τ²-bench results 0% of the Agentic reference weight, so it moves the Agentic leaderboard and the overall ranking. Reference weights are relative weights in the calibrated model, not fixed shares of a score.

About τ²-bench results

Year

2025

Tasks

Airline, retail, and telecom customer-service task sets

Format

Published domain success or pass^k results

Difficulty

Dual-control customer-service workflows

τ²-bench extends the original benchmark with a dual-control telecom domain where the agent and simulated user can both act through tools. The maintained framework also includes airline and retail. BenchLM keeps each exact source attached and labels the published setup instead of treating every row as one controlled run.

Freshness and provenance

Version

τ²-Bench 2026

Refresh cadence

Quarterly

Staleness state

Current

Question availability

Public benchmark set

Current

BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.

Questions

Are all τ²-bench scores directly comparable?

No. Match the domain, task release, agent model, user model, scaffold, prompts, number of trials, and pass^k definition. BenchLM labels each sourced row so a telecom result or third-party implementation is not silently treated as the same setup as an airline, retail, or aggregate result.

Does a high τ²-bench score prove production support reliability?

No. It measures success in simulated customer-service environments under a reported setup. Production identity checks, permission boundaries, changing policies, latency, cost, monitoring, and human escalation still need separate testing.

Last updated: November 21, 2026 · BenchLM version τ²-Bench 2026

Know when it’s worth switching models

The model to choose, the cheaper alternative, and the release we would wait on.

Read a sample issue

Join 7,000+ subscribers.

One email each week. Unsubscribe anytime.