TasksSummarizationBusiness track

Compare two proposals

biz-sum-05suite v1.0text

Quality20%judge panel
Correctness50%deterministic · numeric-check
Completeness30%deterministic · fact-coverage

Exact prompt sent to every model

Below are two vendor proposals for a dental practice's phone system replacement. Write a comparison memo under 500 words for the practice owner: a side-by-side table of the ten things that matter (total 3-year cost including the hidden fees, contract length, hardware ownership, porting, support hours, uptime commitment, integrations, termination terms, implementation time, references), then three paragraphs on the trade-offs, then a recommendation with the one condition you would attach. All costs must be computed from the proposals, not estimated.

A private fixture (biz-sum-05/proposals.md) is shown to the model but not published.

Responses

Latest published run: gemini-3.8-flash. For each model the repeat closest to its published median is shown; every repeat is in the repository.

No published attempts for this task yet

When the run is published, every model's raw response, per-dimension scores, judge rationales, human review notes and rendered artifacts appear here side by side.