Skip to main content

Benchmark profile

CTI-REALM

A cybersecurity benchmark that measures whether an agent can turn raw threat-intelligence reports into working detection rules.

Data verified

Benchmark score on CTI-REALM — July 21, 2026

BenchLM mirrors the published score view for CTI-REALM. Fugu Cyber leads the public snapshot at 72.1%. BenchLM does not use these results to rank models overall.

1 modelAgenticCurrentDisplay onlyUpdated July 21, 2026

Benchmark score table (1 model)

Score
1
Fugu CyberSakana AI · Closed
72.1%

About CTI-REALM

Year

2026

Tasks

Threat-intelligence-to-detection-rule workflows

Format

Success rate

Difficulty

Professional cyber threat detection

Sakana AI describes CTI-REALM as a real-world security benchmark for translating cyber threat intelligence into executable detection rules. We store exact provider-reported results as display-only evidence until the benchmark owner publishes a stable, independently verifiable leaderboard artifact.

BenchLM freshness & provenance

Version

CTI-REALM 2026

Refresh cadence

Quarterly

Staleness state

Current

Question availability

Public benchmark set

CurrentDisplay only

BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.

FAQ

What does CTI-REALM measure?

A cybersecurity benchmark that measures whether an agent can turn raw threat-intelligence reports into working detection rules.

Which model scores highest on CTI-REALM?

Fugu Cyber by Sakana AI currently leads with a score of 72.1% on CTI-REALM.

How many models are evaluated on CTI-REALM?

1 AI models have been evaluated on CTI-REALM on BenchLM.

Last updated: July 21, 2026 · BenchLM version CTI-REALM 2026

Choose a model with this week’s evidence

Join 2,000+ readers for ranking moves, pricing changes, and the claims that still need proof.

One email each week. Unsubscribe anytime.