Step-by-step answer
Core 75–90 min8 stepsMeasure and catch hallucinations in lease extraction
Six synthetic leases with planned silences, a claude -p extraction run with and without a "not_stated" option, and two pure functions, score() and verify_quotes(), that separate invented clauses from wrong answers and check every quote against the clause it cites.
Back to the exercise