TasksSummarizationBusiness track

Meeting transcript to minutes and actions

biz-sum-04suite v1.0text

Quality20%judge panel
Correctness50%judge panel
Completeness30%deterministic · fact-coverage

Exact prompt sent to every model

Below is an auto-generated transcript of a 55-minute church finance committee meeting, with speaker labels and transcription errors. Produce formal minutes: attendees, call to order, each agenda item with a 2-4 sentence summary, motions with mover, seconder and vote result exactly as stated, action items with owner and date, and adjournment time. Do not include discussion that did not lead to a decision or action unless it was explicitly tabled. Under 600 words.

A private fixture (biz-sum-04/transcript.txt) is shown to the model but not published.

Responses

Latest published run: gemini-3.8-flash. For each model the repeat closest to its published median is shown; every repeat is in the repository.

No published attempts for this task yet

When the run is published, every model's raw response, per-dimension scores, judge rationales, human review notes and rendered artifacts appear here side by side.