Step-by-step answer
Stretch 60 min7 stepsConsistency and version regression checks
Consistency and version-regression checks for a System One Choice. On two simulated versions, reordering the options flips 8.3% of answers and paraphrasing the instructions 6.2%; the new version is 4.2 points more accurate but not significantly so (sign test p = 0.79), and the regression check blocks the switch because AML recall falls from 100% to 62%.
Back to the exercise