A public-works help desk concatenates a year of pothole notes into one prompt, and the local model errors on input size. What constraint did the client ignore?
Select an answer to reveal the explanation.
Short Explanation
A year of pothole notes in one prompt blows the tensor-shape budget. Every local model has a max sequence length, so truncate or chunk before the forward pass. A catchier slogan, an NCCL ring, or a product rename will not grow that window.
Full Explanation
Every local model has a maximum sequence length, so a year of concatenated notes is a client bug: truncate or chunk before the forward pass. Wording a nicer slogan does not grow the tensor shape. NCCL ring size is Professional parallelism, not this input-budget error. Renaming the serving product does not change how many tokens the checkpoint accepts.