Model profile
DeepSeek V3
Evidence coverage
22 of 323 tracked benchmarks are published. 1 is verified and 21 provisional. 7 of 8 categories are measured.
- Published / tracked
- 22 / 323
- Verified
- 1
- Provisional
- 21
- Categories with evidence
- 7 / 8
Evidence by category
- Agentic4 benchmarksReported
- Coding4 benchmarksReported
- Reasoning2 benchmarksReported
- Knowledge8 benchmarksReported
- Math1 benchmarkVerified
- Multilingual0 benchmarksNot measured
- Multimodal1 benchmarkReported
- Inst. Following2 benchmarksReported
DeepSeek V3 ranks #147 out of 200 models on the public leaderboard with an overall score of 44.97/100. It also ranks #72 out of 99 on the verified leaderboard. While not a frontier model, it offers specific advantages depending on the use case.
DeepSeek V3 is a open weight model with a 128K token context window. It processes queries without explicit chain-of-thought reasoning, offering faster response times and lower token usage.
This profile currently has 22 of 323 tracked benchmarks. BenchLM only exposes non-generated benchmark rows publicly, so missing categories stay blank until a sourced evaluation is available.
Its strongest category is Agentic (#97), while its weakest is Coding (#101). This performance profile makes it particularly useful for coding agents, browser research, and computer-use workflows.
Peer position
Exact provisional scores and ranks for the closest listed peers. A score can appear before a model clears the evidence threshold for a rank, so equal scores can have different rank states.
Range 44.6–45.13
- Z-1ZCompare#14345.13Z-1 is #143 with a score of 45.13.
- Nemotron-4 15BNVIDIACompare#14445.08Nemotron-4 15B is #144 with a score of 45.08.
- Seed 1.6 FlashByteDanceCompare#14545.08Seed 1.6 Flash is #145 with a score of 45.08.
- Mistral 8x7BMistralCompare#14644.99Mistral 8x7B is #146 with a score of 44.99.
- DeepSeek V3Current modelDeepSeek#14744.97DeepSeek V3 is #147 with a score of 44.97.
- Moonshot v1Moonshot AICompare#14844.79Moonshot v1 is #148 with a score of 44.79.
- Seed-2.0-MiniByteDanceCompare#14944.6Seed-2.0-Mini is #149 with a score of 44.6.
Category percentile
More
Relative position among models eligible for each sourced category. A higher percentile means a stronger position within that category's ranked cohort; 100 is highest.
- Agentic19%Eligible cohort rank #97 of 119Category score 38.5
- Coding17%Eligible cohort rank #101 of 122Category score 42.6
Category evidence
Scores and ranks appear only where this model has published benchmark evidence. Categories without displayable source records remain not measured.
| Category | Score | Rank | Percentile | Weight | Benchmarks | Evidence |
|---|---|---|---|---|---|---|
| AgenticRank #97 of 119Percentile 19thWeight 22%4 benchmarksReported | 38.5 | #97 of 119 | 19th | 22% | 4 benchmarks | Reported |
| CodingRank #101 of 122Percentile 17thWeight 20%4 benchmarksReported | 42.6 | #101 of 122 | 17th | 20% | 4 benchmarks | Reported |
| ReasoningRank Not rankedWeight 17%2 benchmarksReported | 48.7 | Not ranked | Not available | 17% | 2 benchmarks | Reported |
| KnowledgeRank Not rankedWeight 12%8 benchmarksReported | 61.8 | Not ranked | Not available | 12% | 8 benchmarks | Reported |
| MathRank Not rankedWeight 5%1 benchmarkVerified | 26.3 | Not ranked | Not available | 5% | 1 benchmark | Verified |
| MultilingualWeight 7%0 benchmarksNot measured | Not measured | Not ranked | Not available | 7% | 0 benchmarks | Not measured |
| MultimodalWeight 12%1 benchmarkReported | Score pending | Not ranked | Not available | 12% | 1 benchmark | Reported |
| Inst. FollowingRank Not rankedWeight 5%2 benchmarksReported | 86.1 | Not ranked | Not available | 5% | 2 benchmarks | Reported |
Self-host vs API cost
Estimates at 50,000 req/day · 1000 tokens/req average.
Chatbot Arena performance
Scroll horizontally to inspect confidence intervals and vote counts.
| View | Elo | Confidence interval | Votes |
|---|---|---|---|
| Text Overall | 1358 | ±4.8 | 21,770 |
| Coding | 1388 | ±10.1 | 3,280 |
| Math | 1311 | ±10.8 | 2,721 |
| Instruction Following | 1344 | ±6.9 | 8,606 |
| Creative Writing | 1349 | ±10.0 | 3,623 |
| Multi-turn | 1374 | ±9.8 | 3,747 |
| Hard Prompts | 1350 | ±8.1 | 5,408 |
| Hard Prompts (English) | 1362 | ±9.7 | 3,637 |
| Longer Query | 1375 | ±10.6 | 3,123 |
Benchmark Details
Rows below have a displayable published verification record. Each source link and provenance note remains in the page HTML while its category is closed. Source-unverified manual rows and generated rows stay hidden.
Agentic4 benchmarks
Artificial Analysis Agentic Index
τ²-Bench Tool-Agent-User Evaluation
GDPval-AA normalized
Coding4 benchmarks
LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code
Software Engineering Benchmark Verified
Artificial Analysis Coding Index
Artificial Analysis SciCode
Reasoning2 benchmarks
Artificial Analysis Long Context Reasoning
Critical Physics Tasks
Knowledge8 benchmarks
Massive Multitask Language Understanding Professional
Graduate-Level Google-Proof Q&A
Artificial Analysis GPQA Diamond
Artificial Analysis Humanity's Last Exam
Artificial Analysis Omniscience Index
Artificial Analysis Omniscience Accuracy
Artificial Analysis Omniscience Hallucination Rate
Math1 benchmark
FrontierMath v2 Tiers 1-3
Multimodal1 benchmark
Design Arena Website Elo
Inst. Following2 benchmarks
Instruction-Following Eval
Artificial Analysis IFBench
Frequently Asked Questions
How does DeepSeek V3 perform overall in AI benchmarks?
DeepSeek V3 has 22 published benchmark scores on BenchLM, but it does not yet have enough non-generated coverage to receive a global overall rank.
Is DeepSeek V3 good for knowledge and understanding?
DeepSeek V3 has visible benchmark coverage in knowledge and understanding, but BenchLM does not currently assign it a global category rank there.
Is DeepSeek V3 good for coding and programming?
DeepSeek V3 ranks #101 out of 122 models in coding and programming benchmarks with an average score of 42.6. There are stronger options in this category.
Is DeepSeek V3 good for mathematics?
DeepSeek V3 has visible benchmark coverage in mathematics, but BenchLM does not currently assign it a global category rank there.
Is DeepSeek V3 good for reasoning and logic?
DeepSeek V3 has visible benchmark coverage in reasoning and logic, but BenchLM does not currently assign it a global category rank there.
Is DeepSeek V3 good for agentic tool use and computer tasks?
DeepSeek V3 ranks #97 out of 119 models in agentic tool use and computer tasks benchmarks with an average score of 38.5. There are stronger options in this category.
Is DeepSeek V3 good for multimodal and grounded tasks?
DeepSeek V3 has visible benchmark coverage in multimodal and grounded tasks, but BenchLM does not currently assign it a global category rank there.
Is DeepSeek V3 good for instruction following?
DeepSeek V3 has visible benchmark coverage in instruction following, but BenchLM does not currently assign it a global category rank there.
Is DeepSeek V3 open source?
Yes, DeepSeek V3 is an open weight model created by DeepSeek, meaning it can be downloaded and run locally or fine-tuned for specific use cases.
Does DeepSeek V3 have full benchmark coverage on BenchLM?
Not yet. DeepSeek V3 currently has 22 published benchmark scores out of the 323 benchmarks BenchLM tracks. BenchLM only exposes non-generated public benchmark rows, so missing categories stay blank until a sourced evaluation is available.
What is the context window size of DeepSeek V3?
DeepSeek V3 has a published context window of 128K, which determines how much text it can process in a single interaction.
Related Resources
Choose with this week’s evidence
Join 2,000+ readers for ranking moves, new releases, pricing changes, and the evidence behind them.
Free. One email per week.