Module 1 · Building the index · Lesson 1
Embeddings in practice
How to choose an embedding model for specialist retrieval, and how dimensions, Matryoshka truncation and quantisation trade quality against memory, latency and cost.
By the end of this lesson you can
- Choose an embedding model for a specialist corpus using MTEB, a domain benchmark and your own queries, and explain why leaderboard rank alone misleads
- Use query and document input types or prefixes correctly, and explain what breaks when you don't
- Compute the storage and embedding cost of an index at different dimensions and precisions
- Apply Matryoshka truncation and binary or int8 quantisation with rescoring, and predict the quality cost of each