Engineering track · Leaderboard

Debugging

Given code and a symptom, find and fix the real bug without breaking anything else.

suite v1.0Run gemini-3.8-flash · published Sep 21, 2026

Ranking

Score is the mean of task medians (0-100). Consistency is the mean spread across repeats, lower is better. Cost per point is cost per task divided by score.

No scores in this category yet

The published run has no materialised scores for this category. Tasks in the category are listed below.

Tasks in Debugging

Briefs and rubrics are public. Hidden tests, reference answers and private fixtures are not.

  1. 1
    Off-by-one in pagination that only shows at the boundary
    eng-debug-01
  2. 2
    Race condition in a cache warmer
    eng-debug-02
  3. 3
    Time zone bug in appointment reminders
    eng-debug-03
  4. 4
    Memory leak in an event-driven websocket hub
    eng-debug-04
  5. 5
    The bug is in the test
    eng-debug-05