During an AI system audit, the auditor wants to assess whether a tr…

Question

During an AI system audit, the auditor wants to assess whether a training dataset used for a customer churn model is representative of the current customer population. Which audit procedure is MOST appropriate?

Accepted Answer

Compare the statistical distribution of training data features with current production data — Here's the deal — b is correct because assessing dataset representativeness requires comparing the statistical distributions (mean, variance, category proportions) of features in the training data against those of the current population — identifying any systematic misrepresentation. A tests model configuration, not data representativeness.

Answer

Review the model's hyperparameter tuning log for evidence of overfitting

Answer

Confirm that the training data was encrypted at rest using AES-256

Answer

Verify that data scientists used version control for all notebook files

During an AI system audit, the auditor wants to assess whether a training dataset used for a customer churn model is representative of the current customer population. Which audit procedure is MOST appropriate?

Short Explanation and Infographic

Full Explanation