Apply a tiered pricing policy to edge cases

biz-reason-03suite v1.0text

Quality25%judge panel
Correctness65%deterministic · answer-match
Completeness10%judge panel

Exact prompt sent to every model

Apply the policy above to these three clients for November 2026 and compute each monthly invoice. (1) Law firm: 23 users on Nov 1, 2 users added Nov 16, 1 user removed Nov 20, 4 shared mailboxes. (2) Church (nonprofit): 8 users, 2 service accounts, monthly billing. (3) Dental practice: 31 users, annual prepay, invoice the November share. Show the tier math, then end with an "ANSWER:" block listing the three totals to the cent. If any policy rule is ambiguous for a case, say which and state the interpretation you used.

Responses

Latest published run: gemini-3.8-flash. For each model the repeat closest to its published median is shown; every repeat is in the repository.

No published attempts for this task yet

When the run is published, every model's raw response, per-dimension scores, judge rationales, human review notes and rendered artifacts appear here side by side.