A net-mending shed’s care manual is longer than the language stack can hold at once. What does the context window represent for that transformer LLM?
Select an answer to reveal the explanation.
Short Explanation
The context window is the model’s desk size. Pages that do not fit on the desk are simply not in front of attention—extra length is not magically visible.
Full Explanation
The context window is the maximum amount of text a transformer LLM can attend to in a single forward pass. Content beyond that limit is not automatically visible to attention. It is not a billing fee, a promise of infinite visibility, or a vision resolution control.