Retrieval Is Mostly Chunking
Swapping embedding models buys you a little. Getting chunking right buys you a lot. The attention goes the wrong way round.
Placeholder article. Every retrieval system starts with an argument about which embedding model to use. Very few start with an argument about chunking.
Why it dominates
If the answer to a question is split across two chunks, no retriever will find it whole. If a chunk contains four unrelated topics, its embedding means nothing in particular.
Structure beats size
Chunk on the document's own boundaries — sections, clauses, table rows — rather than on a token count that respects nothing.
Replace this placeholder article with your own writing.
Leave a comment