Step-by-step answer
Core 2 hours8 stepsMigrate the summariser behind a regression suite
A 60-case tiered regression suite of synthetic search packs, property graders that never compare exact text, a claude -p runner that logs tokens and cost, and a flip analysis that gates on tiers. The old prompt on the new model passes more cases on average (85% to 90%) and is still blocked, by one safety trial and one past incident; a single edit to a fossil line clears both.
Back to the exercise