An AI auditor uses counterfactual testing during an audit of a hiring algorithm. Which of the following BEST describes what this testing technique reveals?
Select an answer to reveal the explanation.
Short Explanation and Infographic
Here's the deal — b is correct because counterfactual testing — also called individual fairness testing — modifies a single attribute (such as gender or race) while holding all other features constant to determine whether the protected attribute influences the model's decision, which would indicate discriminatory behavior. A describes consistency/reproducibility testing.
Full explanation below image
Full Explanation
B is correct because counterfactual testing — also called individual fairness testing — modifies a single attribute (such as gender or race) while holding all other features constant to determine whether the protected attribute influences the model's decision, which would indicate discriminatory behavior. A describes consistency/reproducibility testing. C describes robustness testing. D describes reproducibility of training.