# Brevity Benchmark (NVIDIA) (Brevity Benchmark)

> NVIDIA benchmark that scores conversational answers on quality and conciseness together.

Canonical page: https://benchlm.ai/benchmarks/brevitybench

- Category: [Instruction Following](/instruction-following)
- Last updated: October 29, 2026

## About Brevity Benchmark

- Year: 2026
- Tasks: Conversational prompts (not yet published)
- Format: Average of quality and conciseness scores
- Difficulty: Concise, speech-ready answers
- Paper: [NVIDIA Nemotron 3.5 Bolt E4B 4GB](https://research.nvidia.com/labs/nemotron/NVIDIA-Nemotron-3.5-Bolt-E4B-4GB/)

NVIDIA reports it for Nemotron 3.5 Bolt E4B (October 23, 2026), run in its NeMo Gym harness, as the average of answer quality and conciseness in reasoning mode. NVIDIA says the benchmark will be released later, so its tasks, judge and scoring are not public yet. We store the launch runs on their own display-only key.

Brevity Benchmark is currently displayed on BenchLM for reference, but it is excluded from the weighted scoring formula.

## Leaderboard (2 models)

| Rank | Model | Creator | Score |
|------|-------|---------|-------|
| 1 | [Nemotron 3.5 Bolt E4B](/models/nemotron-3-5-bolt-e4b) | NVIDIA | 82.84% |
| 2 | [Nemotron 3.5 Bolt E4B BF16](/models/nemotron-3-5-bolt-e4b-bf16) | NVIDIA | 82.52% |

## FAQ

### What does Brevity Benchmark measure?

NVIDIA benchmark that scores conversational answers on quality and conciseness together.

### Which model scores highest on Brevity Benchmark?

Nemotron 3.5 Bolt E4B by NVIDIA currently leads with a score of 82.84% on Brevity Benchmark.

### How many models are evaluated on Brevity Benchmark?

2 AI models have published results on Brevity Benchmark in the BenchLM catalog.

### Does Brevity Benchmark affect BenchLM's overall score?

Not directly. Brevity Benchmark is still displayed on BenchLM for reference, but it is excluded from the weighted scoring formula.

## Compare Top Models on Brevity Benchmark

- [Nemotron 3.5 Bolt E4B vs Nemotron 3.5 Bolt E4B BF16](/compare/nemotron-3-5-bolt-e4b-vs-nemotron-3-5-bolt-e4b-bf16)