A used-record shop wants albums that mean something like a liner-note blurb, not albums that merely share three keywords. The shop is not asking for the model's working-memory size and is not asking for raw word pieces. Which representation should they use?
Select an answer to reveal the explanation.
Short Explanation
Think of matching albums by the vibe of the liner notes, not by three shared keywords. Embeddings are numeric meaning, so similar sense can sit together. Raw tokens chase exact words, and the context-window size is just how much fits.
Full Explanation
Embeddings are numeric vectors that represent meaning, so blurbs with similar sense can match even when keywords differ. Raw tokens are the text pieces themselves and favor exact words. Context-window size is a capacity limit, not a meaning representation. A price forecast does not retrieve similar albums.