Which combination BEST optimizes cost for a nightly document classi…

Question

Which combination BEST optimizes cost for a nightly document classification pipeline?

Accepted Answer

Prompt caching for shared instructions/schemas plus Batch API with an appropriately small capable model — Nightly jobs: cache the shared prompt, batch the volume, pick the smallest model that still hits quality.

Answer

Real-time Opus with streaming for every document and no caching

Answer

Random model selection per document without measurement

Answer

Maximum image resolution on text-only docs

Which combination BEST optimizes cost for a nightly document classification pipeline?

Short Explanation and Infographic

Full Explanation