A public-health FM client sees Amazon Bedrock throttling during an outbreak-driven traffic spike. Which resilience technique should the client implement?
Select an answer to reveal the explanation.
Short Explanation
When the clinic phone lines jam, you wait a bit longer between redials—not mash redial a thousand times a second. Exponential backoff gives Bedrock room to breathe during outbreak spikes.
Full Explanation
Resilient foundation-model API clients handle Amazon Bedrock throttling with exponential backoff and jitter rather than aggressive tight loops that worsen congestion. Public-health outbreak spikes commonly trigger rate limits; waiting progressively longer between retries gives Bedrock room to recover while the civic client remains stable. Jitter prevents synchronized retry storms across many clinic or call-center workers hitting the same quota. Retrying failed calls in a tight infinite loop with zero delay until the process crashes fails resilience and amplifies throttling for everyone sharing the quota. Disabling retries and surfacing raw throttle errors to residents on every attempt fails user experience and abandons transient-fault handling that outbreaks require. Immediately purchasing every available provisioned unit worldwide without reviewing traffic patterns fails cost governance—capacity purchases should follow measured demand, not panic, and do not replace correct client backoff behavior. Exam caveat: backoff is necessary but not sufficient; combine with circuit breakers, queue shedding, and cached outbreak FAQs for the hottest questions. Distinguish throttling from hard authorization errors—do not retry AccessDenied as if it were transient. Cap max retries and surface graceful degradation to clinicians and residents. Operational check: Configure SDK retry mode with exponential backoff and jitter; load-test outbreak-like concurrency; alarm on throttle counts and client retry exhaustion; verify residents see friendly fallback content rather than raw 429 text; and review whether provisioned throughput is justified after measuring sustained demand.