Step-by-step answer
Stretch 45 min6 stepsMeasure prompt fragility
Three meaning-preserving perturbations of the best enquiries-drafter prompt (reorder the firm_policy bullets, rename the tag everywhere, turn the bullets into prose), run on the dev split next to a second, identical run of the original. Scores are compared with the noise floor that identical run gives, counted as paired case flips, so a perturbation is called fragile only when it moves more cases than chance does.
Back to the exercise