Llama 3.1 405B
According to BenchLM.ai, Llama 3.1 405B ranks #78 out of 119 models on the provisional leaderboard with an overall score of 41/100. It does not yet have enough sourced coverage for BenchLM's verified leaderboard. While not a frontier model, it offers specific advantages depending on the use case.
Llama 3.1 405B is a open weight model with a 128K token context window. It processes queries without explicit chain-of-thought reasoning, offering faster response times and lower token usage.
This profile currently has 16 of 225 tracked benchmarks. BenchLM only exposes non-generated benchmark rows publicly, so missing categories stay blank until a sourced evaluation is available.
Its strongest category is Mathematics (#42), while its weakest is Multimodal & Grounded (#72). This performance profile makes it particularly strong for mathematical reasoning, scientific computing, and quantitative analysis.
Ranking Distribution
Category rank across 8 benchmark categories — sorted by best rank
Category Performance
Scores across all benchmark categories (0-100 scale)
Category Breakdown
Agentic
#71Coding
#66Reasoning
#52Knowledge
#64Math
#42Multilingual
#48Multimodal
#72Inst. Following
#51Chatbot Arena Performance
Benchmark Details
Only benchmark rows with an attached exact-source record are shown here. Source-unverified manual rows and generated rows are hidden from model pages.
Compare This Model
See how Llama 3.1 405B stacks up against similar models
Frequently Asked Questions
How does Llama 3.1 405B perform overall in AI benchmarks?
Llama 3.1 405B currently ranks #78 out of 119 models on BenchLM's provisional leaderboard with an overall score of 41 (estimated). It is created by Meta and features a 128K context window.
Is Llama 3.1 405B good for knowledge and understanding?
Llama 3.1 405B ranks #64 out of 119 models in knowledge and understanding benchmarks with an average score of 45.3. There are stronger options in this category.
Is Llama 3.1 405B good for coding and programming?
Llama 3.1 405B ranks #66 out of 119 models in coding and programming benchmarks with an average score of 36.9. There are stronger options in this category.
Is Llama 3.1 405B good for reasoning and logic?
Llama 3.1 405B ranks #52 out of 119 models in reasoning and logic benchmarks with an average score of 50. There are stronger options in this category.
Is Llama 3.1 405B good for agentic tool use and computer tasks?
Llama 3.1 405B ranks #71 out of 119 models in agentic tool use and computer tasks benchmarks with an average score of 31.8. There are stronger options in this category.
Is Llama 3.1 405B good for instruction following?
Llama 3.1 405B ranks #51 out of 119 models in instruction following benchmarks with an average score of 69.6. There are stronger options in this category.
Is Llama 3.1 405B open source?
Yes, Llama 3.1 405B is an open weight model created by Meta, meaning it can be downloaded and run locally or fine-tuned for specific use cases.
Does Llama 3.1 405B have full benchmark coverage on BenchLM?
Not yet. Llama 3.1 405B currently has 16 published benchmark scores out of the 225 benchmarks BenchLM tracks. BenchLM only exposes non-generated public benchmark rows, so missing categories stay blank until a sourced evaluation is available.
What is the context window size of Llama 3.1 405B?
Llama 3.1 405B has a context window of 128K, which determines how much text it can process in a single interaction.
Related Resources
Don't miss the next GPT moment
Which models moved up, what’s new, and what it costs. One email a week, 3-min read.
Free. One email per week.