Alignment, honesty, scheming

Part of the benchmark canon: 4 entries, all measure the model. How to read the Paladin column is defined on the canon page.

BenchmarkOrganizationMeasuresPaladin
MASK Benchmark (top 12)Center for AI SafetyHonesty separated from accuracyMeasures the model
Apollo in-context scheming evaluations (top 12)Apollo ResearchEnvironments that incentivize schemingMeasures the model
Stealth and Situational AwarenessGoogle DeepMind / Apollo ResearchEvaluations backing a scheming-inability safety caseMeasures the model
Situational Awareness DatasetAcademic (Laine et al.)Model self-awareness as a propensityMeasures the model

Previous: CBRN knowledge and bio uplift. Next: Autonomy and AI R&D.