Skip to main content
BenchLM
Data

Data as of October 17, 2026 · How the score is built

EstablishedProprietaryNon-Reasoning

Released Feb 19, 2025128K context

Grok 3 [Beta]

Decision readingGrok 3 [Beta] scores 41 out of 100 and ranks #136 of 224. This profile shows 5 source-displayable benchmark rows; its strongest eligible category is Knowledge at #113. No comparable first-party API price is published in the catalog.

Released Feb 19, 2025 — see all recent releases

Decision snapshot

Each value carries a field reference instead of floating alone. Markers compare this model with the current ranked and priced catalog; they are not absolute quality thresholds.

Capability

41/100

field median 49.6#136 of 224 ranked models

Public

#136of 224

Verified —

Price

API rate not published

input median $0.75No comparable first-party hosted token rate

Speed

Not measured

field median 92 tok/sTime to first token not measured

Context

128Ktokens

field median 256,000Reported for this model; direct source link not stored

Strongest published evidence

Knowledge ranks #113. Particularly effective for knowledge-intensive tasks like research, analysis, and factual Q&A.

Validate before choosing

5 published rows leave some tracked benchmark slots empty. No comparable first-party API token rate is published.

Source-linked · 5 displayable benchmark rows

Category score record

Scores and ranks appear only where published evidence can be displayed. The table keeps the score, weight, cohort, and evidence state together.

Category scores, ranks, weighting, benchmark coverage, and evidence status
CategoryScore
AgenticWeight 22%0 benchmarksNot measured
Not measured
CodingRank Not rankedWeight 20%1 benchmarkVerified
26.0
ReasoningWeight 17%0 benchmarksNot measured
Not measured
MultimodalWeight 12%0 benchmarksNot measured
Not measured
KnowledgeRank #113 of 184Percentile 39thWeight 12%3 benchmarksVerified
41.3
MultilingualWeight 7%0 benchmarksNot measured
Not measured
Inst. FollowingWeight 5%0 benchmarksNot measured
Not measured
MathRank Not rankedWeight 5%1 benchmarkVerified
2.8

5 of 681 tracked benchmark slots have displayable evidence · bars run 0–100

Coverage details

How much of this is verified

Coverage is split by category so a strong number never hides a thin evidence base. Verified means the row is tied to a published source; provisional rows remain visible but separate.

  1. AgenticNot measured
  2. Coding1/1 verified
  3. ReasoningNot measured
  4. MultimodalNot measured
  5. Knowledge3/3 verified
  6. MultilingualNot measured
  7. Inst. FollowingNot measured
  8. Math1/1 verified
Verified sourceProvisionalNot measured

Capability shape

Each axis shows percentile within that category’s eligible cohort. The comparison outline is the median of the six nearest public-score peers; a collapsed vertex means the category is not rank-eligible.

Grok 3 [Beta] category percentile values

  • AgenticNot eligible
  • CodingNot eligible
  • ReasoningNot eligible
  • MultimodalNot eligible
  • Knowledge39th percentile
  • MultilingualNot eligible
  • Instruction followingNot eligible
  • MathNot eligible

The dashed outline is median of 6 nearest peers.

Eligible category ranks

  1. AgenticNot ranked
  2. CodingNot ranked
  3. ReasoningNot ranked
  4. MultimodalNot ranked
  5. Knowledge#113/184
  6. MultilingualNot ranked
  7. Inst. FollowingNot ranked
  8. MathNot ranked
Top decileTop quartileMid-fieldNot eligible

Benchmark ledger

Coding opens by default. The marker compares each value with the best source-verified result in the catalog; provisional leaders do not set the reference. Expand the remaining categories for every published row.

Coding1 row
Coding benchmark values, best verified comparison, weight, and source status
LiveCodeBenchLiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for CodeScore57%Versus best verified row

Best verified: Solar Pro 4 · 87.8%

Gap30.8 behindWeightDisplay only
Knowledge3 rows
Knowledge benchmark values, best verified comparison, weight, and source status
MMLU-ProMassive Multitask Language Understanding ProfessionalScore79.9%Versus best verified row

Best verified: Qwen3.7 Max · 89.6%

Gap9.7 behindWeight6% ref. weight
GPQAGraduate-Level Google-Proof Q&AScore75.4%Versus best verified row

Best verified: GPT-6 Astra · 96%

Gap20.6 behindWeight3% ref. weight
SimpleQAMeasuring Short-Form Factuality in Large Language ModelsScore43.6%Versus best verified row

Best verified: GPT-4.5 · 62.5%

Gap18.9 behindWeightDisplay only
Math1 row
Math benchmark values, best verified comparison, weight, and source status
AIME 2024American Invitational Mathematics Examination 2024Score52.2%Versus best verified row

Best verified: GPT-OSS 120B · 95.8%

Gap43.6 behindWeightDisplay only

Bars run 0–100; the dark tick marks the best source-verified value

All 5 rows

Lineage

The sequence follows explicit supersedes links. Each score is estimated for that model; a relative can inform a sparse estimate but never sets a floor, so a newer release can score below an earlier one. Scores and prices remain blank when the corresponding public row or first-party rate is unavailable.

  1. Feb 19, 2025 · you are here

    Grok 3 [Beta]

    Score 41.0 · Price not listed

snapshot · beta

Spec sheet

Each documented value carries its source. Missing fields stay visible as not sourced or not published, rather than disappearing from the page.

API model ID
Not published
Context window
128K
Maximum output
Not sourced yet
Knowledge cutoff
Not sourced yet
Input modalities
Not sourced yet
Output modalities
Not sourced yet
Parameters
Not disclosed by the provider
Availability
Not sourced yet
Cloud regions
Not tracked yet
Lifecycle
Established
API capabilities
Tool calling, structured outputs, and batch support are not tracked yet
Prompt caching
Not documented in the pricing record
Self-host
Weights are not published
Rate limits
Not tracked yet

How to read this profile

The visual layer above carries the decisions. These notes preserve the model, ranking, coverage, and family context behind the numbers.

Grok 3 [Beta] ranks #136 of 224 on the public leaderboard with a score of 40.98/100. It does not yet have enough sourced coverage for a verified position.

Grok 3 [Beta] is a proprietary model with a 128K context window. No explicit reasoning mode is documented in this profile.

5 of 681 tracked benchmark slots currently have displayable evidence. Missing categories stay blank.

Its strongest eligible category is Knowledge at #113. particularly effective for knowledge-intensive tasks like research, analysis, and factual Q&A.

Last updated October 17, 2026. Runtime fields remain blank until a sourced snapshot exists.

Questions

How does Grok 3 [Beta] perform overall in AI benchmarks?

Grok 3 [Beta] ranks #136 out of 224 models on the public BenchAlign leaderboard, with a score of 40.98/100. Its evidence status is Estimated, and this profile shows 5 source-displayable benchmark rows. The label describes evidence depth, not a provider quality claim; inspect category rows before choosing a workload.

Is Grok 3 [Beta] good for knowledge and understanding?

Grok 3 [Beta] ranks #113 out of 184 eligible models for knowledge and understanding, with a public category score of 41.3/100. Higher-ranked alternatives are available for workloads where this category decides the choice. Check the underlying rows before treating the aggregate as a workload guarantee.

Is Grok 3 [Beta] good for coding and programming?

Grok 3 [Beta] has source-displayable benchmark coverage for coding and programming, but the public category table does not assign it a rank there. The individual rows remain available for inspection. A missing category position means the evidence threshold was not met; it does not convert the model's unmeasured work into a zero.

Is Grok 3 [Beta] good for mathematics?

Grok 3 [Beta] has source-displayable benchmark coverage for mathematics, but the public category table does not assign it a rank there. The individual rows remain available for inspection. A missing category position means the evidence threshold was not met; it does not convert the model's unmeasured work into a zero.

Does Grok 3 [Beta] have full benchmark coverage on BenchLM?

No. Grok 3 [Beta] currently has 5 source-displayable rows across 681 tracked benchmark slots. The profile exposes published, non-generated evidence and leaves missing categories blank until an exact evaluation is available. Coverage describes how much was measured; it is not a penalty added to an individual benchmark result.

What is the context window size of Grok 3 [Beta]?

Grok 3 [Beta] has a reported context window of 128K in the exact-model catalog record. The value stays visible, but the profile marks its source link as unavailable instead of presenting it as directly documented. Maximum output length remains separate because providers often publish a different limit.

Watch Grok 3 [Beta] in the weekly brief

Get one weekly email when material rank, price, availability, or benchmark evidence changes are worth revisiting.

Read a sample issue

Join 5,600+ readers.

Compare Grok 3 [Beta] with every tracked model953 comparisons