Cyber defense and threat intel

Part of the benchmark canon: 8 entries, all measure the model. How to read the Paladin column is defined on the canon page.

BenchmarkOrganizationMeasuresPaladin
CTI-REALMMicrosoftEnd-to-end detection-rule generation by agentsMeasures the model
ExCyTIn-BenchMicrosoftAgent-driven cyber threat investigationMeasures the model
CyberSOCEvalMeta with CrowdStrikeMalware analysis and threat-intel reasoningMeasures the model
CTIBenchAcademic (Alam et al.)Threat-intelligence knowledge, attribution, and severityMeasures the model
CyberMetricTII / Khalifa UniversitySecurity knowledge question answeringMeasures the model
SecBenchTencent / HK PolyULarge multi-domain security question setMeasures the model
SecEvalAcademic (Li et al.)Software, network, and web security questionsMeasures the model
SecQAAcademicFoundational security conceptsMeasures the model

Previous: Cyber offense and CTF. Next: Software security and code.