A consultant reviews a predictive opportunity score for a deal roughly ten times larger than any opportunity in the historical data the model was trained on. The score shows a high likelihood to win, and the rep wants to know how much weight to place on it before allocating executive sponsorship time. What should the consultant advise?
Select an answer to reveal the explanation.
Short Explanation
Picture the scoring model as someone who has only ever seen deals in a certain size range, and now you're asking them to judge something ten times bigger than anything they've handled before. Their gut instinct might still sound confident, but they're really guessing outside their experience, and that's worth knowing before you stake a lot of executive time on the number. The wrong instincts here are either extreme: assuming the tool just refuses to touch anything unusually large, assuming bigger deals must mean better, more trustworthy predictions, or assuming it'll quietly fix itself overnight through some automatic retraining. None of that reflects how these models actually behave. The grounded move is to treat an outlier score as one input among several, lean more heavily on human judgment and deal-specific diligence for something this far outside the norm, and not let a confident-looking number substitute for that scrutiny.
Full Explanation
The correct answer is D. Predictive models learn patterns from the historical opportunities they were trained on, and when a new deal falls far outside the range of values the model has seen, its predictions for that deal become less reliable because the model is extrapolating rather than interpolating from familiar territory. Advising caution and supplementing the score with human judgment for this large outlier is the appropriate response before committing executive sponsorship time. Option A is incorrect because the scoring engine will still generate a numeric score for an outlier opportunity; it does not refuse to score deals above a size threshold, it simply produces a less trustworthy estimate. Option B is incorrect because deal value is only one signal among many the model considers, and there is no guarantee that larger deals produce more accurate scores; in fact the opposite is often true when the model has little comparable training data at that scale. Option C is incorrect because predictive opportunity scoring does not automatically retrain itself in response to a single outlier being scored; retraining typically happens on a scheduled or administrator-initiated basis, not reactively within a day. Recognizing where a model's training data thins out is a core part of using AI-driven scores responsibly rather than treating every number as equally trustworthy.