Step-by-step answer
Core 75 min7 stepsRewrite the searches summariser and measure it
Twelve synthetic search packs with gold findings, a 2023-style legacy prompt and a modern v1, both run three times per pack through claude -p on your subscription with a JSON schema, and a code scorer for action-item recall, false "action" flags and verbatim evidence. The comparison is fair because the two arms share the schema, the user turn and the model, and differ only in the system prompt.
Back to the exercise