# ProgramBench binary score (task counts only at 95% or higher) (ProgramBench (binary))

> ProgramBench cleanroom reimplementation tasks scored as pass/fail: a task counts only when its ProgramBench score is at least 95%.

Canonical page: https://benchlm.ai/benchmarks/programbenchbinary

- Category: [Coding](/coding)
- Last updated: October 29, 2026

## About ProgramBench (binary)

- Year: 2026
- Tasks: Cleanroom executable reimplementation
- Format: Share of tasks at 95% or higher
- Difficulty: Whole-program reconstruction
- Paper: [ProgramBench](https://www.vals.ai/benchmarks/programbench)

Moonshot reports this binary transform rather than the raw ProgramBench score. BenchLM keeps it on its own key so it never mixes with raw or almost-resolved ProgramBench values.

ProgramBench (binary) is currently displayed on BenchLM for reference, but it is excluded from the weighted scoring formula.

## Leaderboard (1 models)

| Rank | Model | Creator | Score |
|------|-------|---------|-------|
| 1 | [Kimi K3.1 Pro](/models/kimi-3-1-pro) | Moonshot AI | 31.5% |

## FAQ

### What does ProgramBench (binary) measure?

ProgramBench cleanroom reimplementation tasks scored as pass/fail: a task counts only when its ProgramBench score is at least 95%.

### Which model scores highest on ProgramBench (binary)?

Kimi K3.1 Pro by Moonshot AI currently leads with a score of 31.5% on ProgramBench (binary).

### How many models are evaluated on ProgramBench (binary)?

1 AI models have published results on ProgramBench (binary) in the BenchLM catalog.

### Does ProgramBench (binary) affect BenchLM's overall score?

Not directly. ProgramBench (binary) is still displayed on BenchLM for reference, but it is excluded from the weighted scoring formula.