Skip to main content

GPT-OSS 120B

OpenAIEstablishedReleased Aug 5, 2025
Overall Score
Est. 34Prov. #87 of 119
Arena Elo
1353
Categories Ranked
8of 8
Price (1M tokens)
$0 in / $0 out
Speed
262tok/s
Context
128K
Open WeightSelf-hostNon-Reasoning
Confidence
base

According to BenchLM.ai, GPT-OSS 120B ranks #87 out of 119 models on the provisional leaderboard with an overall score of 34/100. It does not yet have enough sourced coverage for BenchLM's verified leaderboard. While not a frontier model, it offers specific advantages depending on the use case.

GPT-OSS 120B is a open weight model with a 128K token context window. It processes queries without explicit chain-of-thought reasoning, offering faster response times and lower token usage.

GPT-OSS 120B sits inside the GPT-OSS family alongside GPT-OSS 20B. This profile currently has 19 of 225 tracked benchmarks. BenchLM only exposes non-generated benchmark rows publicly, so missing categories stay blank until a sourced evaluation is available.

Its strongest category is Agentic (#65), while its weakest is Instruction Following (#94). This performance profile makes it particularly useful for coding agents, browser research, and computer-use workflows.

Ranking Distribution

Category rank across 8 benchmark categories — sorted by best rank

Category Performance

Scores across all benchmark categories (0-100 scale)

Category Breakdown

Agentic

#65
34.9/ 100
Weight: 22%6 benchmarks
Terminal-Bench 2.0BrowseCompOSWorld-VerifiedGAIATAU-benchWebArena

Coding

#75
21.9/ 100
Weight: 20%4 benchmarks
SWE-bench VerifiedLiveCodeBenchSWE-bench ProSWE-RebenchSciCode

Reasoning

#70
30.0/ 100
Weight: 17%2 benchmarks
MuSRLongBench v2MRCRv2ARC-AGI-2

Knowledge

#65
44.7/ 100
Weight: 12%6 benchmarks
GPQASuperGPQAMMLU-ProHLEFrontierScienceSimpleQA

Math

#73
26.4/ 100
Weight: 5%0 benchmarks
AIME 2025BRUMO 2025MATH-500FrontierMath

Multilingual

#71
36.5/ 100
Weight: 7%0 benchmarks
MGSMMMLU-ProX

Multimodal

#89
18.8/ 100
Weight: 12%0 benchmarks
MMMU-ProOfficeQA ProCharXivCharXiv w/o tools

Inst. Following

#94
38.6/ 100
Weight: 5%1 benchmark
IFEvalIFBench

Chatbot Arena Performance

Text Overall1353CI: ±4.330,639 votes
Coding1391CI: ±7.76,494 votes
Math1383CI: ±13.71,795 votes
Instruction Following1326CI: ±7.07,814 votes
Creative Writing1278CI: ±9.83,953 votes
Multi-turn1328CI: ±8.75,007 votes
Hard Prompts1362CI: ±5.714,759 votes
Hard Prompts (English)1367CI: ±7.27,638 votes
Longer Query1325CI: ±7.86,453 votes

Benchmark Details

Only benchmark rows with an attached exact-source record are shown here. Source-unverified manual rows and generated rows are hidden from model pages.

GPT-OSS Family

Base entry

Frequently Asked Questions

How does GPT-OSS 120B perform overall in AI benchmarks?

GPT-OSS 120B currently ranks #87 out of 119 models on BenchLM's provisional leaderboard with an overall score of 34 (estimated). It is created by OpenAI and features a 128K context window.

Is GPT-OSS 120B good for knowledge and understanding?

GPT-OSS 120B ranks #65 out of 119 models in knowledge and understanding benchmarks with an average score of 44.7. There are stronger options in this category.

Is GPT-OSS 120B good for coding and programming?

GPT-OSS 120B ranks #75 out of 119 models in coding and programming benchmarks with an average score of 21.9. There are stronger options in this category.

Is GPT-OSS 120B good for reasoning and logic?

GPT-OSS 120B ranks #70 out of 119 models in reasoning and logic benchmarks with an average score of 30. There are stronger options in this category.

Is GPT-OSS 120B good for agentic tool use and computer tasks?

GPT-OSS 120B ranks #65 out of 119 models in agentic tool use and computer tasks benchmarks with an average score of 34.9. There are stronger options in this category.

Is GPT-OSS 120B good for instruction following?

GPT-OSS 120B ranks #94 out of 119 models in instruction following benchmarks with an average score of 38.6. There are stronger options in this category.

Is GPT-OSS 120B open source?

Yes, GPT-OSS 120B is an open weight model created by OpenAI, meaning it can be downloaded and run locally or fine-tuned for specific use cases.

Which sibling models are related to GPT-OSS 120B?

GPT-OSS 120B belongs to the GPT-OSS family. Related variants on BenchLM include GPT-OSS 20B.

Does GPT-OSS 120B have full benchmark coverage on BenchLM?

Not yet. GPT-OSS 120B currently has 19 published benchmark scores out of the 225 benchmarks BenchLM tracks. BenchLM only exposes non-generated public benchmark rows, so missing categories stay blank until a sourced evaluation is available.

What is the context window size of GPT-OSS 120B?

GPT-OSS 120B has a context window of 128K, which determines how much text it can process in a single interaction.

Last updated: June 2, 2026 · Runtime metrics stay blank until BenchLM has a sourced snapshot.

Don't miss the next GPT moment

Which models moved up, what’s new, and what it costs. One email a week, 3-min read.

Free. One email per week.