A city SOC analyst wonders why an LLM summarizing tickets sometimes truncates long permit-system logs. Which AI text-processing limit best explains that behavior?
Select an answer to reveal the explanation.
Short Explanation
An LLM’s context window is like a clipboard that only holds so many pages. Stuff a giant permit-system log on it and the end gets chopped—so the summary misses what didn’t fit.
Full Explanation
A city SOC analyst seeing an LLM truncate long permit-system logs should recognize that context-window and input-length limits can cause long municipal logs to be truncated or incompletely processed. Generative models accept a bounded token budget per request; oversized ticket or log pastes lose head or tail content, so summaries miss evidence that never entered the window. Understanding that limit prevents over-trusting incomplete AI summaries of civic incidents.
Vocabulary limits and formatting constraints only affect how permit-system log text is encoded and counts toward the token budget; they do not themselves truncate logs during summarization, which happens when total input exceeds the context-window and input-length limit.
Rate limits and request quotas do not cause long permit-system logs to be truncated or incompletely processed — they restrict request frequency or volume and trigger throttling or rejections, not silent truncation of long inputs within an accepted request.
Temperature limits and decoding settings control randomness in word choice; they do not truncate long input logs, which is governed by the context-window limit.
Exam caveat: chunking, retrieval, or summarization pipelines can mitigate but also introduce their own omissions; truncation risk remains whenever inputs exceed the active window. Operational check: measure permit-log size against the model’s context limit before summarization, chunk or retrieve relevant spans, spot-check that critical timestamps and host fields appear in the summary, and keep human review on high-impact city tickets.
Prefer to study offline? Printable PDF study book + test engine ($7.50, unofficial). These questions stay free here.