Skip to main content

Model profile

GPT-4o

OpenAISupersededReleased May 13, 2024
Data verified
Superseded:OpenAI has released newer models in this line —GPT-4.1
Overall Score
41.49Public #165 of 200Verified #77 of 99
Arena Elo
1335
Eligible category ranks
0of 8
Price (1M tokens)
$2.5 in / $10 out
API pricing
Speed
131tok/s
Context
128K

Evidence coverage

13 of 321 tracked benchmarks are published. 1 is verified and 12 provisional. 7 of 8 categories are measured.

Updated July 20, 2026Methodology
Published / tracked
13 / 321
Verified
1
Provisional
12
Categories with evidence
7 / 8

Evidence by category

  • Agentic1 benchmark
    Reported
  • Coding1 benchmark
    Reported
  • Reasoning2 benchmarks
    Reported
  • Knowledge6 benchmarks
    Reported
  • Math1 benchmark
    Verified
  • Multilingual0 benchmarks
    Not measured
  • Multimodal1 benchmark
    Reported
  • Inst. Following1 benchmark
    Reported
ProprietaryNon-Reasoning
Confidence:
Low
base

GPT-4o ranks #165 out of 200 models on the public leaderboard with an overall score of 41.49/100. It also ranks #77 out of 99 on the verified leaderboard. While not a frontier model, it offers specific advantages depending on the use case.

GPT-4o is a proprietary model with a 128K token context window. It processes queries without explicit chain-of-thought reasoning, offering faster response times and lower token usage.

GPT-4o sits inside the GPT-4o family alongside GPT-4o mini. This profile currently has 13 of 321 tracked benchmarks. BenchLM only exposes non-generated benchmark rows publicly, so missing categories stay blank until a sourced evaluation is available.

Peer position

Exact provisional scores and ranks for the closest listed peers. A score can appear before a model clears the evidence threshold for a rank, so equal scores can have different rank states.

Range 41.1342.06

  1. GPT-4.1 nano
    OpenAI
    #16142.06
    GPT-4.1 nano is #161 with a score of 42.06.
    Compare
  2. Gemma 4 E2B
    Google
    #16241.82
    Gemma 4 E2B is #162 with a score of 41.82.
    Compare
  3. Mistral Large 2
    Mistral
    #16341.77
    Mistral Large 2 is #163 with a score of 41.77.
    Compare
  4. Gemma 3 27B
    Google
    #16441.57
    Gemma 3 27B is #164 with a score of 41.57.
    Compare
  5. GPT-4oCurrent model
    OpenAI
    #16541.49
    GPT-4o is #165 with a score of 41.49.
  6. LFM2.5-8B-A1B
    LiquidAI
    #16641.42
    LFM2.5-8B-A1B is #166 with a score of 41.42.
    Compare
  7. Claude 3 Opus
    Anthropic
    #16841.13
    Claude 3 Opus is #168 with a score of 41.13.
    Compare

Category percentile

More

Relative position among models eligible for each sourced category. A higher percentile means a stronger position within that category's ranked cohort; 100 is highest.

No eligible category percentile is available from the published evidence yet.

Category evidence

Scores and ranks appear only where this model has published benchmark evidence. Categories without displayable source records remain not measured.

Category scores, ranks, weighting, benchmark coverage, and evidence status
CategoryScore
AgenticRank Not rankedWeight 22%1 benchmarkReported51.5
CodingRank Not rankedWeight 20%1 benchmarkReported32.1
ReasoningRank Not rankedWeight 17%2 benchmarksReported62.4
KnowledgeRank Not rankedWeight 12%6 benchmarksReported35.8
MathRank Not rankedWeight 5%1 benchmarkVerified25.4
MultilingualWeight 7%0 benchmarksNot measuredNot measured
MultimodalRank Not rankedWeight 12%1 benchmarkReported72.4
Inst. FollowingRank Not rankedWeight 5%1 benchmarkReported82.0

Chatbot Arena performance

Scroll horizontally to inspect confidence intervals and vote counts.

Chatbot Arena Elo, confidence interval, and vote count by evaluation view
ViewEloConfidence intervalVotes
Text Overall1335Not availableNot available

Benchmark Details

Rows below have a displayable published verification record. Each source link and provenance note remains in the page HTML while its category is closed. Source-unverified manual rows and generated rows stay hidden.

Agentic1 benchmark
τ²-bench resultsReported

τ²-Bench Tool-Agent-User Evaluation

25.1%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
Coding1 benchmark
AA-SciCodeReported

Artificial Analysis SciCode

33.3%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
Reasoning2 benchmarks
AA-LCRReported

Artificial Analysis Long Context Reasoning

0.0%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
CritPtReported

Critical Physics Tasks

0.0%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
Knowledge6 benchmarks
Artificial Analysis Intelligence IndexReported
11.2%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
AA-GPQA DiamondReported

Artificial Analysis GPQA Diamond

54.3%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
AA-HLEReported

Artificial Analysis Humanity's Last Exam

3.3%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
AA-Omniscience IndexReported

Artificial Analysis Omniscience Index

-10.7%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
AA-Omniscience AccuracyReported

Artificial Analysis Omniscience Accuracy

19.7%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
AA-Omniscience Hallucination RateReported

Artificial Analysis Omniscience Hallucination Rate

37.9%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
Math1 benchmark
FrontierMath v2 (Tiers 1-3)Benchmark exact

FrontierMath v2 Tiers 1-3

0.345%Weighted 30%
Source: Epoch AI FrontierMath v2 leaderboardProvenance: Epoch AI reports FrontierMath v2 Tiers 1-3 at 0.345% for gpt-4o-2024-08-06. BenchLM selects the highest published thinking effort for the model and stores the v2 benchmark slice separately.
Multimodal1 benchmark
Design Arena WebsiteReported

Design Arena Website Elo

864Display only
Source: OpenRouter model benchmarksProvenance: Display-only Design Arena Website Elo synced from OpenRouter model benchmark metadata. It is excluded from BenchLM weighted scoring.
Inst. Following1 benchmark
AA-IFBenchReported

Artificial Analysis IFBench

34.3%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.

GPT-4o Family

Base entry

Frequently Asked Questions

How does GPT-4o perform overall in AI benchmarks?

GPT-4o has 13 published benchmark scores on BenchLM, but it does not yet have enough non-generated coverage to receive a global overall rank.

Is GPT-4o good for knowledge and understanding?

GPT-4o has visible benchmark coverage in knowledge and understanding, but BenchLM does not currently assign it a global category rank there.

Is GPT-4o good for coding and programming?

GPT-4o has visible benchmark coverage in coding and programming, but BenchLM does not currently assign it a global category rank there.

Is GPT-4o good for mathematics?

GPT-4o has visible benchmark coverage in mathematics, but BenchLM does not currently assign it a global category rank there.

Is GPT-4o good for reasoning and logic?

GPT-4o has visible benchmark coverage in reasoning and logic, but BenchLM does not currently assign it a global category rank there.

Is GPT-4o good for agentic tool use and computer tasks?

GPT-4o has visible benchmark coverage in agentic tool use and computer tasks, but BenchLM does not currently assign it a global category rank there.

Is GPT-4o good for multimodal and grounded tasks?

GPT-4o has visible benchmark coverage in multimodal and grounded tasks, but BenchLM does not currently assign it a global category rank there.

Is GPT-4o good for instruction following?

GPT-4o has visible benchmark coverage in instruction following, but BenchLM does not currently assign it a global category rank there.

Which sibling models are related to GPT-4o?

GPT-4o belongs to the GPT-4o family. Related variants on BenchLM include GPT-4o mini.

Does GPT-4o have full benchmark coverage on BenchLM?

Not yet. GPT-4o currently has 13 published benchmark scores out of the 321 benchmarks BenchLM tracks. BenchLM only exposes non-generated public benchmark rows, so missing categories stay blank until a sourced evaluation is available.

What is the context window size of GPT-4o?

GPT-4o has a published context window of 128K, which determines how much text it can process in a single interaction.

Last updated: July 20, 2026 · Runtime metrics stay blank until BenchLM has a sourced snapshot.

Choose with this week’s evidence

Join 2,000+ readers for ranking moves, new releases, pricing changes, and the evidence behind them.

Free. One email per week.