Exact prompt sent to every model
Below is a Python/FastAPI search endpoint over a matters table for a law firm, using raw SQL with
string formatting, plus its ORM models. Identify every security issue, then rewrite the endpoint so it
is safe while preserving all current search features (partial match on title, filter by status list,
sort by any of four allowed columns, pagination). Return the changed file(s) with # file: <path>
first lines and a findings list.
A private fixture (eng-sec-02/src) is shown to the model but not published.
Responses
Latest published run: gemini-3.8-flash. For each model the repeat closest to its published median is shown; every repeat is in the repository.
No published attempts for this task yet
When the run is published, every model's raw response, per-dimension scores, judge rationales, human review notes and rendered artifacts appear here side by side.