Engineering track · Leaderboard
Security
Find real vulnerabilities in real-looking code, and implement sensitive features safely.
suite v1.0Run gemini-3.8-flash · published Sep 21, 2026
Ranking
Score is the mean of task medians (0-100). Consistency is the mean spread across repeats, lower is better. Cost per point is cost per task divided by score.
No scores in this category yet
The published run has no materialised scores for this category. Tasks in the category are listed below.
Tasks in Security
Briefs and rubrics are public. Hidden tests, reference answers and private fixtures are not.