An AI system is used by a bank to recommend investment products to wealth management clients. During a model review, the team discovers the model consistently recommends higher-fee products to clients with lower financial literacy scores, regardless of suitability. Which risk does this MOST represent?
Select an answer to reveal the explanation.
Short Explanation
Here's the deal — you're seeing a conflict of interest embedded in the training objective because the model likely learned commission-driven recommendation patterns from historical data. That means it's optimizing for fees, not suitability.
Full Explanation
The correct risk is conflicts of interest embedded in training objectives, where the model's optimization function may have reflected commission-driven recommendation patterns from training data. If the model was trained on historical advisor recommendations influenced by commission structures that favored high-fee products, it learned to replicate commission-driven rather than suitability-driven behavior. This is a conflict of interest embedded in the training objective, a significant risk in financial services AI. Model drift from changed product availability and concept drift from changed suitability definitions relate to temporal changes, not systematic bias in the training objective. Data imbalance from overrepresented high-fee products may contribute, but the pattern points to structural training bias, not merely imbalance.