A platform receives bursts of 500 requests per second to the Claude API and observes intermittent 529 (overloaded) and 529 errors that are distinct from 429 rate limit errors. The team's current retry logic uses a fixed 1-second delay. What retry strategy should replace this?
Select an answer to reveal the explanation.
Short Explanation and Infographic
Here's the deal — b is correct because exponential backoff with jitter is the standard recommended pattern for handling transient API overload. Pure exponential backoff without jitter causes synchronized retry storms when multiple clients all wait the same delay; jitter spreads retries across a time window, reducing thundering-herd pressure on the API.
Full explanation below image
Full Explanation
B is correct because exponential backoff with jitter is the standard recommended pattern for handling transient API overload. Pure exponential backoff without jitter causes synchronized retry storms when multiple clients all wait the same delay; jitter spreads retries across a time window, reducing thundering-herd pressure on the API. Capping at a maximum prevents indefinite waits. This is explicitly recommended in Anthropic's API documentation for handling both 429 and 529 errors. C is wrong because a fixed 30-second delay does not solve the retry storm problem — all clients still retry at the same time after 30 seconds; it only shifts the storm. A is wrong because Anthropic does not expose multiple geographic endpoints that clients can route between; 529 errors are API-level overload conditions, not region-specific failures that routing can circumvent. B is wrong because disabling retries in the platform layer and pushing responsibility to callers increases integration complexity and results in a worse client experience; the platform should handle transient errors transparently.