TasksDocument ExtractionBusiness track

Vendor invoice to JSON

biz-extract-01suite v1.0json

Quality15%judge panel
Correctness70%deterministic · field-match
Completeness15%deterministic · schema-validate

Exact prompt sent to every model

Extract the invoice below into JSON matching this schema exactly. Use null for anything not present. Dates as YYYY-MM-DD. Money as numbers with two decimals, no currency symbols. Return only the JSON. {"vendor_name","vendor_address","vendor_tax_id","invoice_number","invoice_date","due_date", "po_number","bill_to_name","currency","line_items":[{"description","quantity","unit_price","amount"}], "subtotal","tax_rate_percent","tax_amount","shipping","total","payment_terms","remit_to_bank_last4"}

A private fixture (biz-extract-01/invoice.txt) is shown to the model but not published.

Responses

Latest published run: gemini-3.8-flash. For each model the repeat closest to its published median is shown; every repeat is in the repository.

No published attempts for this task yet

When the run is published, every model's raw response, per-dimension scores, judge rationales, human review notes and rendered artifacts appear here side by side.