Oversized models on small serving instances often cause:
Select an answer to reveal the explanation.
Short Explanation and Infographic
Big model + tiny instance = OOM and flap. Right-size or shrink the model.
Full explanation below image
Full Explanation
Capacity planning includes model memory footprint.