A county-fair pie-score model is invoked a few dozen times on fair weekend and then sits idle for months. The board will not pay for an instance that stays up. A cold start of a few seconds is acceptable. Which serving mode fits?
Select an answer to reveal the explanation.
Short Explanation
The pie-score model fires a few dozen times on fair weekend and then sits idle for months. Serverless inference drops idle instance cost to zero, and a short cold start is fine. An always-on fleet bills through winter, batch is not a per-request invoke, and Polly is not that mode.
Full Explanation
SageMaker serverless inference fits intermittent or unpredictable traffic when idle instance cost must go to zero and a short cold start is acceptable. An always-on real-time fleet keeps billing. Batch transform is not a per-request fair-weekend invoke. Polly is not that mode.