API and library functions that do not exist

biz-halluc-05suite v1.0text

Quality15%judge panel
Correctness80%deterministic · hallucination-grader
Completeness5%judge panel

Exact prompt sent to every model

A developer asks the following eight questions, each about a specific function, cmdlet, flag or configuration key in a well-known library or tool. Some exist, some are plausible inventions, some existed but were removed. For each, say whether it exists in the current stable version, what to use instead if not, and indicate when you are not certain. Do not write example code using anything you are not sure exists.

A private fixture (biz-halluc-05/questions.md) is shown to the model but not published.

Responses

Latest published run: gemini-3.8-flash. For each model the repeat closest to its published median is shown; every repeat is in the repository.

No published attempts for this task yet

When the run is published, every model's raw response, per-dimension scores, judge rationales, human review notes and rendered artifacts appear here side by side.