Client-side throttling to a model endpoint helps:
Select an answer to reveal the explanation.
Short Explanation and Infographic
Client throttles + backoff protect both sides under load.
Full explanation below image
Full Explanation
Responsible client design.