TasksSecurityEngineering track

Review an infrastructure config

eng-sec-04suite v1.0text

Quality15%judge panel
Correctness55%deterministic · vuln-checklist
Completeness30%judge panel

Exact prompt sent to every model

Below are a docker-compose.yml, an nginx.conf, and a .env.example for a small SaaS deployment. Review them for security misconfigurations. For each finding give severity, the exact line, why it matters, and the corrected snippet. Group findings by file. Do not pad the list with style comments.

A private fixture (eng-sec-04/infra) is shown to the model but not published.

Responses

Latest published run: gemini-3.8-flash. For each model the repeat closest to its published median is shown; every repeat is in the repository.

No published attempts for this task yet

When the run is published, every model's raw response, per-dimension scores, judge rationales, human review notes and rendered artifacts appear here side by side.