OOM on executors during vectorized inference often fixed by:

Question

Accepted Answer

Tuning partition size, batch sizes, and executor memory/overhead appropriately — Executor OOMs → fix partitions, batch sizes, executor mem — not only the driver.

Answer

Ignoring partition sizes

Answer

Increasing only driver memory when executors fail

Answer

Turning off Arrow always

OOM on executors during vectorized inference often fixed by:

Short Explanation and Infographic

Full Explanation