A customer service bot maintains multi-turn conversations with users. After 20 turns, the team notices that Claude starts 'forgetting' context from early in the conversation. Token usage logs show conversations approaching 150,000 tokens. What is the architecturally correct solution?
Select an answer to reveal the explanation.
Short Explanation and Infographic
Here's the deal — d is correct because conversation summarization preserves semantic continuity while reducing token count — the summary captures the essential context (user's issue, what was tried, current state) in far fewer tokens than the raw turns. New turns are appended after the summary, so the conversation can continue indefinitely.
Full explanation below image
Full Explanation
D is correct because conversation summarization preserves semantic continuity while reducing token count — the summary captures the essential context (user's issue, what was tried, current state) in far fewer tokens than the raw turns. New turns are appended after the summary, so the conversation can continue indefinitely. C is wrong because simply truncating old messages loses critical context — the customer's original complaint, their account details shared early, and prior resolution attempts may all be in the truncated portion, causing the bot to ask for information already provided. A is wrong because max_tokens controls the length of the model's output, not the size of the context window it can process — increasing it does not expand context retention. B is wrong because the Anthropic Claude API is stateless — there is no server-side conversation state endpoint; conversation history must be managed client-side.