After a prompt change to the triage agent, automated offline scores looked fine on a tiny smoke set, but production customer satisfaction for multi-agent resolutions dropped 12% week over week. On-call had no alert because only infrastructure uptime was monitored. What monitoring capability should be added?
Select an answer to reveal the explanation.
Short Explanation
Infra green while quality red is a common multi-agent failure mode. You need behavioral drift and quality regression monitoring—task success, groundedness, eval scores—with alerts—not just uptime. Coffee machines and LOC counts are jokes relative to production answer quality. B is the right monitoring design.
Full Explanation
Correct answer: B. Monitoring strategies for multi-agent solutions include cross-agent coordination tracking, behavioral drift and quality regression detection, and automated remediation for agent failure patterns. Quality can degrade while infrastructure remains healthy; product metrics and eval signals must be first-class monitors.
A is incorrect because uptime alone misses semantic regressions from prompt/model/tool changes.
C is incorrect because unrelated facility signals do not detect agent quality drift.
D is incorrect because source line count is not a production quality metric for agent outcomes.
Exam focus: multi-agent monitoring must include quality regression, not only platform availability.