Model profile
Grok 3 [Beta]
Evidence coverage
2 of 321 tracked benchmarks are published. 2 are verified and 0 provisional. 1 of 8 categories are measured.
- Published / tracked
- 2 / 321
- Verified
- 2
- Provisional
- 0
- Categories with evidence
- 1 / 8
Evidence by category
- Agentic0 benchmarksNot measured
- Coding0 benchmarksNot measured
- Reasoning0 benchmarksNot measured
- Knowledge0 benchmarksNot measured
- Math2 benchmarksVerified
- Multilingual0 benchmarksNot measured
- Multimodal0 benchmarksNot measured
- Inst. Following0 benchmarksNot measured
Grok 3 [Beta] ranks #171 out of 200 models on the public leaderboard with an overall score of 40.43/100. It also ranks #79 out of 99 on the verified leaderboard. While not a frontier model, it offers specific advantages depending on the use case.
Grok 3 [Beta] is a proprietary model with a 128K token context window. It processes queries without explicit chain-of-thought reasoning, offering faster response times and lower token usage.
This profile currently has 2 of 321 tracked benchmarks. BenchLM only exposes non-generated benchmark rows publicly, so missing categories stay blank until a sourced evaluation is available.
Peer position
Exact provisional scores and ranks for the closest listed peers. A score can appear before a model clears the evidence threshold for a rank, so equal scores can have different rank states.
Range 39.8–40.7
- Sarvam 30BSarvamCompare#16940.7Sarvam 30B is #169 with a score of 40.7.
- Grok 3 [Beta]Current modelxAI#17140.43Grok 3 [Beta] is #171 with a score of 40.43.
- Ministral 3 8B (Reasoning)MistralCompare#17240.38Ministral 3 8B (Reasoning) is #172 with a score of 40.38.
- Mistral 7B v0.3MistralCompare#17339.9Mistral 7B v0.3 is #173 with a score of 39.9.
- Llama 4 ScoutMetaCompare#17439.87Llama 4 Scout is #174 with a score of 39.87.
- Qwen2.5-VL-32BAlibabaCompare#17539.85Qwen2.5-VL-32B is #175 with a score of 39.85.
- Llama 4 BehemothMetaCompare#17639.8Llama 4 Behemoth is #176 with a score of 39.8.
Category percentile
More
Relative position among models eligible for each sourced category. A higher percentile means a stronger position within that category's ranked cohort; 100 is highest.
Category evidence
Scores and ranks appear only where this model has published benchmark evidence. Categories without displayable source records remain not measured.
| Category | Score | Rank | Percentile | Weight | Benchmarks | Evidence |
|---|---|---|---|---|---|---|
| AgenticWeight 22%0 benchmarksNot measured | Not measured | Not ranked | Not available | 22% | 0 benchmarks | Not measured |
| CodingWeight 20%0 benchmarksNot measured | Not measured | Not ranked | Not available | 20% | 0 benchmarks | Not measured |
| ReasoningWeight 17%0 benchmarksNot measured | Not measured | Not ranked | Not available | 17% | 0 benchmarks | Not measured |
| KnowledgeWeight 12%0 benchmarksNot measured | Not measured | Not ranked | Not available | 12% | 0 benchmarks | Not measured |
| MathRank Not rankedWeight 5%2 benchmarksVerified | 27.1 | Not ranked | Not available | 5% | 2 benchmarks | Verified |
| MultilingualWeight 7%0 benchmarksNot measured | Not measured | Not ranked | Not available | 7% | 0 benchmarks | Not measured |
| MultimodalWeight 12%0 benchmarksNot measured | Not measured | Not ranked | Not available | 12% | 0 benchmarks | Not measured |
| Inst. FollowingWeight 5%0 benchmarksNot measured | Not measured | Not ranked | Not available | 5% | 0 benchmarks | Not measured |
Chatbot Arena performance
Scroll horizontally to inspect confidence intervals and vote counts.
| View | Elo | Confidence interval | Votes |
|---|---|---|---|
| Text Overall | 1402 | Not available | Not available |
Benchmark Details
Rows below have a displayable published verification record. Each source link and provenance note remains in the page HTML while its category is closed. Source-unverified manual rows and generated rows stay hidden.
Math2 benchmarks
FrontierMath v2 Tiers 1-3
FrontierMath v2 Tier 4
Frequently Asked Questions
How does Grok 3 [Beta] perform overall in AI benchmarks?
Grok 3 [Beta] has 2 published benchmark scores on BenchLM, but it does not yet have enough non-generated coverage to receive a global overall rank.
Is Grok 3 [Beta] good for mathematics?
Grok 3 [Beta] has visible benchmark coverage in mathematics, but BenchLM does not currently assign it a global category rank there.
Does Grok 3 [Beta] have full benchmark coverage on BenchLM?
Not yet. Grok 3 [Beta] currently has 2 published benchmark scores out of the 321 benchmarks BenchLM tracks. BenchLM only exposes non-generated public benchmark rows, so missing categories stay blank until a sourced evaluation is available.
What is the context window size of Grok 3 [Beta]?
Grok 3 [Beta] has a published context window of 128K, which determines how much text it can process in a single interaction.
Related Resources
Choose with this week’s evidence
Join 2,000+ readers for ranking moves, new releases, pricing changes, and the evidence behind them.
Free. One email per week.