Coding Benchmarks
Programming and software development - Compare AI models across 1 programming benchmarks including HumanEval, CodeContest, and more.
Filters & Search
Filter models by creator, type, reasoning, or search by name to find the perfect AI model for your needs
Coding Benchmark Results
Showing 25 of 52 models • Click column headers to sort
1 GPT-5 (high) OpenAI | OpenAI | Proprietary | Reasoning | 128K | 72 | 85% |
2 o1-preview OpenAI | OpenAI | Proprietary | Reasoning | 200K | 71 | 86% |
3 GPT-5 (medium) OpenAI | OpenAI | Proprietary | Reasoning | 128K | 70 | 83% |
4 Grok 4 xAI | xAI | Proprietary | Non-Reasoning | 128K | 69 | 79% |
5 GPT-5 mini OpenAI | OpenAI | Proprietary | Reasoning | 128K | 68 | 80% |
6 o3-pro OpenAI | OpenAI | Proprietary | Reasoning | 200K | 68 | 80% |
7 o3 OpenAI | OpenAI | Proprietary | Reasoning | 200K | 67 | 78% |
8 Qwen2.5-1M Alibaba | Alibaba | Open Weight | Non-Reasoning | 1M | 66 | 76% |
9 Qwen2.5-72B Alibaba | Alibaba | Open Weight | Non-Reasoning | 128K | 65 | 75% |
10 o4-mini (high) OpenAI | OpenAI | Proprietary | Non-Reasoning | 200K | 65 | 74% |
11 Gemini 2.5 Pro Google | Proprietary | Non-Reasoning | 2M | 65 | 75% | |
12 DeepSeek Coder 2.0 DeepSeek | DeepSeek | Open Weight | Non-Reasoning | 128K | 64 | 82% |
13 DeepSeek LLM 2.0 DeepSeek | DeepSeek | Open Weight | Non-Reasoning | 128K | 63 | 73% |
14 Claude 4.1 Opus Anthropic | Anthropic | Proprietary | Non-Reasoning | 200K | 61 | 68% |
15 Claude 4 Sonnet Anthropic | Anthropic | Proprietary | Non-Reasoning | 200K | 59 | 65% |
16 Llama 3.1 405B Meta | Meta | Open Weight | Non-Reasoning | 128K | 58 | 62% |
17 Mistral Large 2 Mistral | Mistral | Proprietary | Non-Reasoning | 128K | 57 | 60% |
18 GPT-4o OpenAI | OpenAI | Proprietary | Non-Reasoning | 128K | 56 | 58% |
19 Claude 3.5 Sonnet Anthropic | Anthropic | Proprietary | Non-Reasoning | 200K | 55 | 57% |
20 Gemini 1.5 Pro Google | Proprietary | Non-Reasoning | 2M | 54 | 56% | |
21 Mistral 8x7B Mistral | Mistral | Open Weight | Non-Reasoning | 32K | 52 | 55% |
22 Gemini 1.0 Pro Google | Proprietary | Non-Reasoning | 32K | 52 | 54% | |
23 Claude 3 Opus Anthropic | Anthropic | Proprietary | Non-Reasoning | 200K | 51 | 53% |
24 GPT-4 Turbo OpenAI | OpenAI | Proprietary | Non-Reasoning | 128K | 50 | 52% |
25 Llama 3 70B Meta | Meta | Open Weight | Non-Reasoning | 128K | 48 | 50% |
Showing 25 of 52 models
About Coding Benchmarks
HumanEval
Python programming problems with test cases