During an AI risk assessment of a clinical decision support system, risk analysts debate whether the AI's recommendation errors are more harmful than equivalent errors by human clinicians. Which risk concept does this debate MOST engage?
Select an answer to reveal the explanation.
Short Explanation and Infographic
Here's the deal — a is correct because automation bias — the tendency for humans to defer to automated systems even when their own judgment would lead to a different (correct) conclusion — is the core risk in clinical AI: the AI's errors may be more harmful not because the AI is worse, but because clinicians over-rely on it and fail to catch its mistakes. B is a generalization without empirical basis.
Full explanation below image
Full Explanation
A is correct because automation bias — the tendency for humans to defer to automated systems even when their own judgment would lead to a different (correct) conclusion — is the core risk in clinical AI: the AI's errors may be more harmful not because the AI is worse, but because clinicians over-rely on it and fail to catch its mistakes. B is a generalization without empirical basis. C oversimplifies FDA standards. D is a data regulatory concern unrelated to the debate described.