Step-by-step answer
Core 90–120 min7 stepsBuild and measure a hybrid PII detector
A three-layer PII detector on 15 synthetic conveyancing documents. Presidio patterns plus custom title-number, sort-code, account, address and proprietor recognisers come first, then spaCy NER, then a claude -p pass whose spans are kept only if they appear in the text. Recall is scored strictly (a half-redacted name is a leak) and converted into leaks per matter, and pseudonyms are HMAC tokens of canonicalised values, so the same person gets the same token everywhere.
Back to the exercise