Jailbreak and refusal

Part of the benchmark canon: 6 entries, all measure the model. How to read the Paladin column is defined on the canon page.

BenchmarkOrganizationMeasuresPaladin
HarmBench (top 12)Center for AI SafetyStandardized red-teaming with classifier gradingMeasures the model
StrongREJECTUC BerkeleyJailbreak scoring that discounts low-quality answersMeasures the model
JailbreakBenchAcademicOpen jailbreak robustness suiteMeasures the model
XSTestAcademic (Rottger et al.)Over-refusal of safe requestsMeasures the model
SORRY-BenchPrinceton / Virginia TechFine-grained refusal across 45 unsafe topicsMeasures the model
AdvBenchCMU / Center for AI SafetyAdversarial harmful-behavior promptsMeasures the model

Previous: Software security and code. Next: CBRN knowledge and bio uplift.