Quiz 4 Question 12 of 20

A content moderation platform processes 1 million requests per day and has identified that 70% of requests are short user messages (under 200 tokens) but their system prompt contains detailed guidelines (6,000 tokens). With caching, they pay cache_write once and cache_read for subsequent hits. They calculate that without caching, daily system prompt cost is $6,000. With caching at 90% hit rate: cache writes cost 10% of baseline, cache reads cost 1% of baseline. What is the approximate daily cost of system prompt tokens with caching enabled?

Select an answer to reveal the explanation.

Motivation