Patch reproduction, exploit synthesis, and prompt-injection defense sit on one calibrated scale
This board combines seven open and benchmark-owner security protocols led by CyberGym (32%), ExploitGym (27%), PromptArmor Frontier Breach (13%). CyberGym and BinaryAudit test whether an agent can locate and reproduce real software vulnerabilities inside containerized targets, ExploitGym and ExploitBench test whether it can turn crash inputs into working exploits, and PromptArmor Frontier Breach plus Gray Swan IPI measure whether untrusted inputs hijack the model.
We calibrate each protocol with BenchAlign v6.0 item-response difficulty parameters instead of averaging raw percentages, because a 30% solve rate on containerized exploit tasks is harder than an 85% defense rate on prompt-injection suites. Every scored row must also qualify for the general catalog, which keeps narrow single-task harnesses from distorting the scale.