Mitigations for serving cold starts include:

Question

Accepted Answer

Min replicas, warmup requests, lighter models, or provisioned capacity — Fight cold starts with min replicas, warmup, lighter models, or provisioned capacity.

Answer

Always scale to zero with no warmup on strict 10ms SLAs

Answer

Ignoring min replica settings

Answer

Redeploying every request

Mitigations for serving cold starts include:

Short Explanation and Infographic

Full Explanation