Quiz 1 Question 14 of 20

A production system makes 1,000 API calls per day where each call uses an identical 2,000-token system prompt followed by unique user messages averaging 500 tokens. The architect wants to reduce input token costs. Which feature should be applied?

Select an answer to reveal the explanation.

Motivation