Quality25%judge panel
Correctness65%deterministic · sqlite-compare
Completeness10%judge panel
Exact prompt sent to every model
Write a SQLite query returning, for every attorney and every calendar month from 2026-01 through 2026-08 (even months with no entries), columns attorney_name, month (YYYY-MM), billable_hours, nonbillable_hours, utilization (billable / (billable + nonbillable), NULL when both zero, rounded to 3 places). Use a recursive CTE to generate months. Order by attorney_name, month. Return only the SQL.
Responses
Latest published run: gemini-3.8-flash. For each model the repeat closest to its published median is shown; every repeat is in the repository.
No published attempts for this task yet
When the run is published, every model's raw response, per-dimension scores, judge rationales, human review notes and rendered artifacts appear here side by side.