Before distributed training on a skewed dataset, repartitioning can help by:
Select an answer to reveal the explanation.
Short Explanation and Infographic
Repartition to balance work — skew makes one executor the straggler.
Full explanation below image
Full Explanation
Partition balance affects distributed training/featurization throughput.