Snow-plow routing jobs sometimes receive poison messages that crash…

Question

Snow-plow routing jobs sometimes receive poison messages that crash workers and block the queue. How should the team ensure recoverability?

Accepted Answer

Make workers idempotent and route repeatedly failing messages to a dead-letter queue (DLQ) for isolation and analysis — A bad snow-route message shouldn’t freeze the whole plow plan. Idempotent workers plus a DLQ quarantine the poison so good jobs keep moving.

Answer

Retry forever on the main queue with no DLQ so poison messages stay at the head indefinitely

Answer

Drop failed messages silently with no DLQ and no metrics

Answer

Process each message exactly once in memory with no persistence and no retry controls

Snow-plow routing jobs sometimes receive poison messages that crash workers and block the queue. How should the team ensure recoverability?

Short Explanation

Full Explanation