Step-by-step answer
Core 75 min8 stepsBuild and break an experiment analysis
A 60-day matter-level A/B simulator for the enquiries drafter, with hash-based sticky assignment, a registry-fallback fault that moves hard treatment matters into control, a chi-square SRM check and a fixed-horizon two-proportion test. Repeating each scenario 300 times shows what one run hides, and 500 A/A experiments show daily peeking turns a 5% false-positive rate into about 34%.
Back to the exercise