Step-by-step answer
Stretch 45–60 min6 stepsLog the model that answered, and catch an alias move
A run log that wraps any System One client and writes one JSON line per call with the requested and the answering model, plus a drift report that warns when more than one model answered, when the pinned one didn't, or when a question's mean confidence moved by more than 0.1. A simulated alias move drops topic confidence from 0.55 to 0.22 while the top choice stays the same.
Back to the exercise