Skip to main content

GPT-OSS 20B

OpenAIEstablishedReleased Aug 5, 2025
Overall Score
Est. 17Prov. #114 of 119
Arena Elo
1318
Categories Ranked
8of 8
Price (1M tokens)
$0 in / $0 out
Speed
313tok/s
Context
128K
Open WeightSelf-hostNon-Reasoning
Confidence
mini

According to BenchLM.ai, GPT-OSS 20B ranks #114 out of 119 models on the provisional leaderboard with an overall score of 17/100. It does not yet have enough sourced coverage for BenchLM's verified leaderboard. While not a frontier model, it offers specific advantages depending on the use case.

GPT-OSS 20B is a open weight model with a 128K token context window. It processes queries without explicit chain-of-thought reasoning, offering faster response times and lower token usage.

GPT-OSS 20B sits inside the GPT-OSS family alongside GPT-OSS 120B. This profile currently has 18 of 225 tracked benchmarks. BenchLM only exposes non-generated benchmark rows publicly, so missing categories stay blank until a sourced evaluation is available.

Its strongest category is Agentic (#80), while its weakest is Multimodal & Grounded (#104). This performance profile makes it particularly useful for coding agents, browser research, and computer-use workflows.

Ranking Distribution

Category rank across 7 benchmark categories — sorted by best rank

Category Performance

Scores across all benchmark categories (0-100 scale)

Category Breakdown

Agentic

#80
21.4/ 100
Weight: 22%5 benchmarks
Terminal-Bench 2.0BrowseCompOSWorld-VerifiedGAIATAU-benchWebArena

Coding

#87
9.9/ 100
Weight: 20%4 benchmarks
SWE-bench VerifiedLiveCodeBenchSWE-bench ProSWE-RebenchSciCode

Reasoning

#88
11.6/ 100
Weight: 17%2 benchmarks
MuSRLongBench v2MRCRv2ARC-AGI-2

Knowledge

#102
6.0/ 100
Weight: 12%6 benchmarks
GPQASuperGPQAMMLU-ProHLEFrontierScienceSimpleQA

Math

#85
2.0/ 100
Weight: 5%0 benchmarks
AIME 2025BRUMO 2025MATH-500FrontierMath

Multilingual

#91
4.8/ 100
Weight: 7%0 benchmarks
MGSMMMLU-ProX

Multimodal

#104
1.5/ 100
Weight: 12%0 benchmarks
MMMU-ProOfficeQA ProCharXivCharXiv w/o tools

Inst. Following

#119
0.0/ 100
Weight: 5%1 benchmark
IFEvalIFBench

Chatbot Arena Performance

Text Overall1318CI: ±6.410,633 votes
Coding1370CI: ±12.92,167 votes
Math1336CI: ±22.0680 votes
Instruction Following1281CI: ±12.12,554 votes
Creative Writing1238CI: ±18.21,242 votes
Multi-turn1292CI: ±14.21,839 votes
Hard Prompts1323CI: ±8.84,797 votes
Hard Prompts (English)1338CI: ±12.32,446 votes
Longer Query1301CI: ±13.42,093 votes

Benchmark Details

Only benchmark rows with an attached exact-source record are shown here. Source-unverified manual rows and generated rows are hidden from model pages.

GPT-OSS Family

Mini

Canonical Entry

GPT-OSS 120B

Frequently Asked Questions

How does GPT-OSS 20B perform overall in AI benchmarks?

GPT-OSS 20B currently ranks #114 out of 119 models on BenchLM's provisional leaderboard with an overall score of 17 (estimated). It is created by OpenAI and features a 128K context window.

Is GPT-OSS 20B good for knowledge and understanding?

GPT-OSS 20B ranks #102 out of 119 models in knowledge and understanding benchmarks with an average score of 6. There are stronger options in this category.

Is GPT-OSS 20B good for coding and programming?

GPT-OSS 20B ranks #87 out of 119 models in coding and programming benchmarks with an average score of 9.9. There are stronger options in this category.

Is GPT-OSS 20B good for reasoning and logic?

GPT-OSS 20B ranks #88 out of 119 models in reasoning and logic benchmarks with an average score of 11.6. There are stronger options in this category.

Is GPT-OSS 20B good for agentic tool use and computer tasks?

GPT-OSS 20B ranks #80 out of 119 models in agentic tool use and computer tasks benchmarks with an average score of 21.4. There are stronger options in this category.

Is GPT-OSS 20B good for instruction following?

GPT-OSS 20B ranks #119 out of 119 models in instruction following benchmarks with an average score of 0. There are stronger options in this category.

Is GPT-OSS 20B open source?

Yes, GPT-OSS 20B is an open weight model created by OpenAI, meaning it can be downloaded and run locally or fine-tuned for specific use cases.

Which sibling models are related to GPT-OSS 20B?

GPT-OSS 20B belongs to the GPT-OSS family. Related variants on BenchLM include GPT-OSS 120B.

Does GPT-OSS 20B have full benchmark coverage on BenchLM?

Not yet. GPT-OSS 20B currently has 18 published benchmark scores out of the 225 benchmarks BenchLM tracks. BenchLM only exposes non-generated public benchmark rows, so missing categories stay blank until a sourced evaluation is available.

What is the context window size of GPT-OSS 20B?

GPT-OSS 20B has a context window of 128K, which determines how much text it can process in a single interaction.

Last updated: June 2, 2026 · Runtime metrics stay blank until BenchLM has a sourced snapshot.

Don't miss the next GPT moment

Which models moved up, what’s new, and what it costs. One email a week, 3-min read.

Free. One email per week.