Skip to main content
BenchLM

Artificial Analysis Openness Index (AA Openness Index)

We show this table for reference; we do not rank on it.

Data verified 34 confirmed releases in the last 30 daysFollow model changes

A display-only Artificial Analysis model-openness index.

Benchmark score on AA Openness Index — September 27, 2026

We compile the AA Openness Index rows from secondary reports. Nemotron 3 Ultra leads the table at 83.3%, followed by Nemotron 3.5 Lightning 30B A3B NVFP4 (83.3%) and MiniCPM5-1B (83.3%). We do not use these results to rank models overall.

1Open weights

Nemotron 3 Ultra

NVIDIA

83.3%
Overall 43.3Context 1M
2Open weights

Nemotron 3.5 Lightning 30B A3B NVFP4

NVIDIA

83.3%
Overall 19.1Context 1M
3Open weights

MiniCPM5-1B

OpenBMB

83.3%
Overall 4.1Context 131K

4 modelsKnowledgeCurrentDisplay onlyUpdated September 27, 2026

Benchmark score table (4 models)

Score
1
Nemotron 3 UltraNVIDIA · Open weight
83.3%
2
Nemotron 3.5 Lightning 30B A3B NVFP4NVIDIA · Open weight
83.3%
3
MiniCPM5-1BOpenBMB · Open weight
83.3%
4
Nemotron 3 Nano 30BNVIDIA · Open weight
83.3%

Among the reported AA Openness Index rows, Nemotron 3 Ultra is first at 83.3%. The third row is 0.0 points behind. The broader top-10 range is 0.0 points, so many of the published results sit in a relatively narrow band.

4 models have been evaluated on AA Openness Index. The benchmark falls in the Knowledge category. AA Openness Index is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.

About AA Openness Index

Year

2026

Tasks

Model openness assessment

Format

Index score

Difficulty

Display-only external reference

Stored separately from capability benchmarks and excluded from weighted scoring.

Artificial Analysis Openness Index

Freshness and provenance

Version

AA Openness Index 2026

Refresh cadence

Quarterly

Staleness state

Current

Question availability

Public benchmark set

CurrentDisplay only

BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.

Questions

What does AA Openness Index measure?

A display-only Artificial Analysis model-openness index.

Which model scores highest on AA Openness Index?

Nemotron 3 Ultra by NVIDIA currently leads with a score of 83.3% on AA Openness Index.

How many models are evaluated on AA Openness Index?

4 AI models have been evaluated on AA Openness Index on BenchLM.

Compare top models on AA Openness Index

Nemotron 3 Ultra vs Nemotron 3.5 Lightning 30B A3B NVFP4Nemotron 3.5 Lightning 30B A3B NVFP4 vs MiniCPM5-1BMiniCPM5-1B vs Nemotron 3 Nano 30B
Last updated: September 27, 2026 · BenchLM version AA Openness Index 2026

Know when it’s worth switching models

The model to choose, the cheaper alternative, and the release we would wait on.

Read a sample issue

Join 2,000+ readers.

One email each week. Unsubscribe anytime.