Which policy applies

biz-reason-04suite v1.0text

Quality25%judge panel
Correctness65%deterministic · answer-match
Completeness10%judge panel

Exact prompt sent to every model

Below are three overlapping company policies (remote work, expense reimbursement, and equipment) with effective dates and precedence rules, followed by six employee scenarios. For each scenario, determine the outcome, cite the controlling section(s), and note any conflict and how the precedence rule resolves it. End with an "ANSWER:" block listing scenario number and outcome as Approved / Denied / Partially approved (amount).

A private fixture (biz-reason-04/policies-and-scenarios.md) is shown to the model but not published.

Responses

Latest published run: gemini-3.8-flash. For each model the repeat closest to its published median is shown; every repeat is in the repository.

No published attempts for this task yet

When the run is published, every model's raw response, per-dimension scores, judge rationales, human review notes and rendered artifacts appear here side by side.