Step-by-step answer
Core 90 min8 stepsStructure-aware and contextual chunking, measured
Four chunking strategies (fixed 400/50 windows, structure-aware packing, structure plus headers, structure plus a claude -p generated context) indexed over three synthetic matters and scored on 40 labelled questions about one of them. Besides recall@5 and recall@20, every strategy is also scored at an equal token budget, because a chunk that covers ten blocks scores a hit far more easily than one that covers one.
Back to the exercise