Excessive HPO parallelism can hurt when:
Select an answer to reveal the explanation.
Short Explanation and Infographic
Too much parallel HPO can starve sequential learners and spike cost.
Full explanation below image
Full Explanation
Parallelism vs sample-efficiency tradeoff.