A community-college LMS tester mixes up “how the story is chopped,” “how each piece is numbered for meaning,” and “how much of the log still fits.” Which statement keeps the three LLM basics correctly separated?
Select an answer to reveal the explanation.
Short Explanation
Chop the loaf, weigh each slice, then check how many slices fit in the toaster—three jobs, not one. Tokenization splits, embeddings encode meaning, and the context window caps prior text. Pasting test artefacts is easier when those three stay distinct.
Full Explanation
Testers need three separate mechanics when working with LLMs on stories and logs. Tokenization breaks input into tokens; embeddings give those tokens semantic numeric form; the context window bounds how much preceding text, measured in tokens, remains available. Collapsing them into one label or swapping their definitions causes wrong troubleshooting when a long paste misbehaves. They are not interchangeable names for next-token prediction or instruction tuning.