A model deployed in SAS Model Manager is monitored using PROC ASSESS. The data scientist wants to track Kolmogorov-Smirnov (KS) statistic over monthly scoring runs. What does a significantly increasing KS statistic over time indicate?
Select an answer to reveal the explanation.
Short Explanation and Infographic
Here's the deal — c is correct because in the context of model monitoring, the KS statistic from PROC ASSESS measures the maximum difference between the cumulative distribution of predicted scores for events vs. non-events.
Full explanation below image
Full Explanation
C is correct because in the context of model monitoring, the KS statistic from PROC ASSESS measures the maximum difference between the cumulative distribution of predicted scores for events vs. non-events. A declining (not increasing) KS over time indicates the model is losing its ability to separate classes. However, the question states 'significantly increasing KS distance between score distributions' — if this means the divergence between training-time and current-time score distributions is increasing, that signals data drift and performance degradation. A and B describe improvements, not degradation. D is wrong because KS is a primary monitoring metric.