APEX-1 — Mercor evaluation (APEX-1 (Mercor))

We captured Mercor's APEX-1 results on October 15, 2026. The table preserves 70 published configurations, their source identifiers, reasoning settings, and disclosed mean score values. These are results from Mercor's evaluation setup; we did not rerun them.

This dated source table is display only and does not enter overall or category rankings. Source configurations retain their external identity, including Pro descriptors and different effort settings.

Mean score is rubric-criterion coverage, not the fraction of tasks fully completed. The leaderboard description lists 400 tasks and eight runs, while the general methodology lists 300 tasks and four runs. We preserve the published aggregates and sample counts without choosing a common denominator or combining these results with another APEX edition.

The row labels retain published error margins and sample counts when supplied. Missing margins and counts remain unreported; a sample count is not used to reconstruct a task denominator. Except where the dedicated source defines an interval, the confidence level is unreported. Equal displayed scores and overlapping margins do not establish statistical ties. Capture time does not establish individual evaluation dates.

The general methodology lists expert-authored rubrics, scored criterion by criterion and a judge of LLM judge over expert rubrics. Its run-count label is k = 4. The linked result page takes precedence where its setup differs, as noted above.