What typically reduces prompt cache hit rates?

Question

Accepted Answer

Frequently changing the beginning of the prompt so prefixes no longer match — Cache likes stable prefixes. If you reshuffle the front of the prompt every call, hits go to zero.

Answer

Keeping a stable system prompt prefix

Answer

Reusing identical tool schemas

Answer

Using the same documents in the same order

What typically reduces prompt cache hit rates?

Short Explanation and Infographic

Full Explanation