Quiz 9 Question 11 of 20

A developer wants to add prompt caching to a RAG pipeline where the system prompt contains static instructions (2,000 tokens), followed by dynamically retrieved documents that change per query (average 8,000 tokens), followed by the user query (average 200 tokens). Where should cache_control breakpoints be placed to maximize cache hit rate?

Select an answer to reveal the explanation.

Motivation