Exact prompt sent to every model
Below is a Python module that warms a cache of exchange rates from an upstream API, used by several
worker threads. Symptom: "Under load we occasionally see the same rate fetched 6-8 times in the same
second, and about once a day a KeyError on a currency we definitely warmed." Find the root cause(s) and
fix them without changing the public functions' signatures. Return the changed file(s) with a
# file: <path> first line, then explain in 3-8 sentences.
A private fixture (eng-debug-02/src) is shown to the model but not published.
Responses
Latest published run: gemini-3.8-flash. For each model the repeat closest to its published median is shown; every repeat is in the repository.
No published attempts for this task yet
When the run is published, every model's raw response, per-dimension scores, judge rationales, human review notes and rendered artifacts appear here side by side.