Low-level mapPartitions inference is sometimes used to:
Select an answer to reveal the explanation.
Short Explanation and Infographic
Load model once per partition, score many rows — amortize load overhead.
Full explanation below image
Full Explanation
Advanced distributed inference optimization.