A company uses an AI system to dynamically price ride-sharing services during periods of high demand. During a natural disaster evacuation, the system prices rides at 6x the normal rate, triggering public backlash. Which AI risk category does this MOST represent?
Select an answer to reveal the explanation.
Short Explanation
Here's the deal — you're looking at value alignment failure because the system is doing exactly what it was built to do: chase revenue. That output clashes with emergency ethics and societal expectations, so the objective itself is misaligned.
Full Explanation
The value alignment failure where the model's optimization objective (revenue) conflicts with broader societal values and emergency ethics norms is correct because the model is optimizing for what it was designed to optimize — revenue through dynamic pricing — while the output conflicts with human values, ethical norms, and societal expectations during an emergency. Regulatory compliance risk from violating price gouging laws may be present, but it is a downstream consequence, not the root risk category. Operational risk from the model making pricing decisions without human review during an emergency may also be present, but the deeper cause is value misalignment between the optimization objective and ethical norms. Model accuracy risk because the demand prediction model overestimated evacuation demand is wrong because the model is not shown to be inaccurate; it is doing what it was designed to do.