Skip to main content

Llama 3.1 405B

MetaEstablishedReleased Jul 23, 2024
Overall Score
Coming soon
Arena Elo
1293
Categories Ranked
8of 8
Price (1M tokens)
$0 in / $0 out
Speed
29tok/s
Context
128K
Open WeightNon-Reasoning
Confidence
base

BenchLM is tracking Llama 3.1 405B, but sourced benchmark results are not published on the site yet. This page currently shows the model metadata we can verify now, and score-level benchmark coverage will appear once public evaluations land.

Llama 3.1 405B is a open weight model with a 128K token context window. It processes queries without explicit chain-of-thought reasoning, offering faster response times and lower token usage.

This profile currently has 0 sourced benchmarks on BenchLM, so the benchmark sections below are intentionally marked as coming soon.

Its strongest category is Mathematics (#44), while its weakest is Multimodal & Grounded (#72). This performance profile makes it particularly strong for mathematical reasoning, scientific computing, and quantitative analysis.

Ranking Distribution

Category rank across 8 benchmark categories — sorted by best rank

Category Performance

Scores across all benchmark categories (0-100 scale)

Category Breakdown

Agentic

#69
34.1/ 100
Weight: 22%0 benchmarks
Terminal-Bench 2.0BrowseCompOSWorld-VerifiedGAIATAU-benchWebArena

Coding

#57
38.6/ 100
Weight: 20%0 benchmarks
SWE-bench VerifiedLiveCodeBenchSWE-bench ProSWE-RebenchSciCode

Reasoning

#52
51.0/ 100
Weight: 17%0 benchmarks
MuSRLongBench v2MRCRv2ARC-AGI-2

Knowledge

#56
48.1/ 100
Weight: 12%0 benchmarks
GPQASuperGPQAMMLU-ProHLEFrontierScienceSimpleQA

Math

#44
58.0/ 100
Weight: 5%0 benchmarks
AIME 2025BRUMO 2025MATH-500FrontierMath

Multilingual

#45
63.5/ 100
Weight: 7%0 benchmarks
MGSMMMLU-ProX

Multimodal

#72
43.6/ 100
Weight: 12%0 benchmarks
MMMU-ProOfficeQA Pro

Inst. Following

#45
70.4/ 100
Weight: 5%0 benchmarks
IFEvalIFBench

Chatbot Arena Performance

Text Overall1293

Benchmark Details

Only benchmark rows with an attached exact-source record are shown here. Source-unverified manual rows and generated rows are hidden from model pages.

Frequently Asked Questions

How does Llama 3.1 405B perform overall in AI benchmarks?

BenchLM is tracking Llama 3.1 405B, but sourced benchmark coverage is still coming soon. We currently list its creator, model type, and context window while we wait for public benchmark results.

Is Llama 3.1 405B open source?

Yes, Llama 3.1 405B is an open weight model created by Meta, meaning it can be downloaded and run locally or fine-tuned for specific use cases.

Does Llama 3.1 405B have full benchmark coverage on BenchLM?

Not yet. Llama 3.1 405B currently has 0 published benchmark scores out of the 152 benchmarks BenchLM tracks. BenchLM only exposes non-generated public benchmark rows, so missing categories stay blank until a sourced evaluation is available.

What is the context window size of Llama 3.1 405B?

Llama 3.1 405B has a context window of 128K, which determines how much text it can process in a single interaction.

Last updated: April 20, 2026 · Runtime metrics stay blank until BenchLM has a sourced snapshot.

Don't miss the next GPT moment

Which models moved up, what’s new, and what it costs. One email a week, 3-min read.

Free. One email per week.