A bank's product agent quotes a brochure that is accurate for a product this customer is not allowed to buy. Products the customer can buy sit in another library the agent does not search. What should the architect correct?
Select an answer to reveal the explanation.
Short Explanation
An accurate brochure for a product this customer cannot buy is the right page from the wrong book. You fix relevance by grounding the answer on products this customer is allowed to buy. Throwing out brochures for being a week old solves a freshness problem this case does not have.
Full Explanation
Relevance is whether the grounded text applies to this user and this question. The brochure is accurate and still the wrong source, because this customer is not allowed to buy that product, while the eligible products sit in a library the agent does not search. The correction is to ground the answer on that eligible library. Timeliness, pursued by removing every brochure older than this week, throws out sources for age even when the customer is eligible, and it does not point the agent at the products this customer can buy. A custom model, justified by the claim that an accurate brochure means the wording is the defect, trains past a retrieval problem and leaves the ineligible brochure in the path. A line in the system prompt that says to sound more relevant does not change which library is searched, so the same ineligible brochure can still be quoted. Accuracy of a source is not relevance to the customer in front of the agent. Exam caveat: a true statement about the wrong product is still a grounding miss. Operational check: ask about products as a test customer with a known eligible set and confirm the reply cites only that set.