False-premise business questions

biz-halluc-02suite v1.0text

Quality15%judge panel
Correctness80%deterministic · hallucination-grader
Completeness5%judge panel

Exact prompt sent to every model

Answer the following eight questions from a small-business owner. Several contain a false premise (a product feature that does not exist, a regulation that was repealed, a misattributed statistic, a vendor that never offered a program). Correct the premise where it is wrong before answering, and answer the real underlying need.

A private fixture (biz-halluc-02/questions.md) is shown to the model but not published.

Responses

Latest published run: gemini-3.8-flash. For each model the repeat closest to its published median is shown; every repeat is in the repository.

No published attempts for this task yet

When the run is published, every model's raw response, per-dimension scores, judge rationales, human review notes and rendered artifacts appear here side by side.