Skip to main content
Radar

Five or fewer confirmed AI changes, with original sources, on mornings when something changed.A free source-linked morning brief.

Start free brief

Vals CyberBench (CyberBench)

Can autonomous agents craft PoC inputs that trigger OSS-Fuzz vulnerabilities—and stop crashing after the fix?

Data verified 24 confirmed releases in the last 30 daysStart free brief

How BenchLM shows CyberBench

BenchLM mirrors the public Vals AI CyberBench leaderboard captured from https://www.vals.ai/benchmarks/cyber and updated by Vals on August 3, 2026. The snapshot preserves overall scores, uncertainty, latency, cost-per-test metadata, and task-level scores where Vals publishes them.

CyberBench is display only on BenchLM. Vals proprietary or Vals-hosted aggregate views are useful context, but BenchLM does not use them as weighted ranking inputs or as a replacement for benchmark-native source records.

Snapshot

22 Vals rows3 task viewsprivate datasetTasks: Overall, PoC, PatchDisplay only

CyberBench score on CyberBench — August 3, 2026

We mirror the published cyberbench score view for CyberBench. GPT-5.6 Sol leads the public snapshot at 88.14%, followed by GPT-5.6 Luna (83.90%) and GPT-5.5 (80.51%). We do not use these results to rank models overall.

22 modelsExternal benchmark mirrorsCurrentDisplay onlyUpdated August 3, 2026

CyberBench score table (22 models)

Score
1
GPT-5.6 SolOpenAI · Closed
88.14%
2
GPT-5.6 LunaOpenAI · Closed
83.90%
3
GPT-5.5OpenAI · Closed
80.51%
4
Kimi K3Moonshot AI · Closed
79.03%
5
DeepSeek V4 Flash 0731DeepSeek · Closedhigh reasoning
77.45%
6
GLM-5.2Z.AI · Open weight
77.36%
7
MiniMax M3MiniMax · Open weight
76.27%
8
Kimi K2.6Moonshot AI · Open weight
74.35%
9
GPT-5.4OpenAI · Closed
72.88%
10
Gemini 3.5 Flash-LiteGoogle · Closedhigh reasoning
72.32%
11
Gemini 3.5 FlashGoogle · Closed
69.33%
12
Inkling-SmallThinking Machines Lab · Open weight0.99 reasoning
68.75%
13
DeepSeek V4 Pro 0813DeepSeek · Closed
68.64%
14
DeepSeek V4 Flash 0731DeepSeek · Closed
66.72%
15
InklingThinking Machines Lab · Open weight
64.14%
16
Claude Opus 4.7Anthropic · Closed
52.14%
17
Claude Opus 4.8Anthropic · Closed
50.85%
18
Gemini 3.6 FlashGoogle · Closedhigh reasoning
48.51%
19
Grok 4.3xAI · Closed
47.46%
20
Claude Opus 5Anthropic · Closed
40.68%
21
Qwen3.7 PlusAlibaba · Closed
37.50%

The published CyberBench snapshot places GPT-5.6 Sol first at 88.14%. The third row is 7.63 points behind. The broader top-10 range is 15.82 points, so the table still separates the published systems.

22 models have been evaluated on CyberBench. The benchmark falls in the External benchmark mirrors category. We keep external benchmark mirrors separate from the weighted global scoring system, so these results remain source-specific evidence. CyberBench is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.

About CyberBench

Year

2026

Tasks

OSS-Fuzz PoC and patch-verification tasks

Format

Accuracy score

Difficulty

Autonomous cybersecurity exploit reproduction

BenchLM mirrors the public Vals AI CyberBench leaderboard as display-only external evidence. The captured snapshot preserves overall scores, task-level scores where Vals publishes them, uncertainty, latency, and cost-per-test metadata. It is excluded from BenchLM weighted rankings.

BenchLM freshness & provenance

Version

CyberBench 2026

Refresh cadence

Quarterly

Staleness state

Current

Question availability

Public benchmark set

CurrentDisplay only

BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.

FAQ

What does CyberBench measure?

Can autonomous agents craft PoC inputs that trigger OSS-Fuzz vulnerabilities—and stop crashing after the fix?

Which model leads the published CyberBench snapshot?

GPT-5.6 Sol currently leads the published CyberBench snapshot with 88.14% cyberbench score. BenchLM shows this benchmark for display only and does not use it in overall rankings.

How many models are evaluated on CyberBench?

22 AI models are included in BenchLM's mirrored CyberBench snapshot, based on the public leaderboard captured on August 3, 2026.

Last updated: August 3, 2026 · mirrored from the public benchmark leaderboard

Know when it’s worth switching models

The model to choose, the cheaper alternative, and the release we would wait on.

Read a sample issue

Join 2,000+ readers.

One email each week. Unsubscribe anytime.