Exact prompt sent to every model
Below is a 9-page managed-services agreement as text. Extract: parties (array of {name, role, state_of_organization}), effective_date, initial_term_months, renewal {auto_renews (bool), renewal_term_months, notice_days}, fees {monthly_fee, onboarding_fee, annual_increase_percent_cap}, payment_terms_days, late_fee_percent_monthly, termination_for_convenience {allowed (bool), notice_days, early_termination_fee_months}, liability_cap {type: "fees_paid"|"fixed"|"uncapped", months_or_amount}, governing_law_state, venue, insurance_required (array of {type, minimum_amount}), sla {uptime_percent, response_time_hours_p1}, data_return_days_after_termination. Use null where the agreement is silent. Return only the JSON.
A private fixture (biz-extract-03/msa.txt) is shown to the model but not published.
Responses
Latest published run: gemini-3.8-flash. For each model the repeat closest to its published median is shown; every repeat is in the repository.
No published attempts for this task yet
When the run is published, every model's raw response, per-dimension scores, judge rationales, human review notes and rendered artifacts appear here side by side.