Step-by-step answer
Core 90 min7 stepsBuild a paired eval gate for CI
A standard-library eval gate that compares a baseline and a candidate on the same 200 synthetic cases, with per-category rules (zero new failures on arithmetic, drop limits elsewhere) and a paired McNemar test, a power simulation showing how much pairing buys, and a GitHub Actions workflow that fails the pull request with the case IDs.
Back to the exercise