An AI audit of a document classification system reveals the model achieves 95% accuracy overall but only 71% accuracy on documents from a specific business unit. What audit follow-up action is MOST appropriate?
Select an answer to reveal the explanation.
Short Explanation and Infographic
Here's the deal — b is correct because a 24-point accuracy gap for a specific subpopulation warrants investigation into root causes — whether the training data underrepresents that unit's documents — and a risk-based decision about whether model use in that unit should be restricted pending remediation. A ignores a significant subpopulation performance failure.
Full explanation below image
Full Explanation
B is correct because a 24-point accuracy gap for a specific subpopulation warrants investigation into root causes — whether the training data underrepresents that unit's documents — and a risk-based decision about whether model use in that unit should be restricted pending remediation. A ignores a significant subpopulation performance failure. C is disproportionate. D misclassifies this as a cybersecurity issue.