Benchmark profile
FrontierSWE
An ultra-long-horizon software-engineering benchmark with open-ended implementation, performance, and research tasks designed to challenge frontier coding agents.
Data verifiedBenchmark score on FrontierSWE — July 16, 2026
BenchLM mirrors the published score view for FrontierSWE. Kimi K3 leads the public snapshot at 81.2%. BenchLM does not use these results to rank models overall.
Benchmark score table (1 model)
ScoreAbout FrontierSWE
Year
2026
Tasks
17 ultra-long-horizon engineering and research tasks
Format
Mean@5, best@5, average rank, and dominance
Difficulty
Ultra-long-horizon frontier software engineering
FrontierSWE's first release contains 17 tasks across implementation, performance, and research. Agents receive up to 20 hours per task, run five trials, and are compared using mean@5, best@5, average rank, and dominance. Moonshot reports Kimi K3's dominance score after recomputing it from raw scores with the official evaluation script.
BenchLM freshness & provenance
Version
FrontierSWE 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
FAQ
What does FrontierSWE measure?
An ultra-long-horizon software-engineering benchmark with open-ended implementation, performance, and research tasks designed to challenge frontier coding agents.
Which model scores highest on FrontierSWE?
Kimi K3 by Moonshot AI currently leads with a score of 81.2% on FrontierSWE.
How many models are evaluated on FrontierSWE?
1 AI models have been evaluated on FrontierSWE on BenchLM.
The AI models change fast. We track them for you.
A weekly brief for engineers and researchers covering new models, ranking shifts, and pricing changes.
Free. No spam. Unsubscribe anytime.