A municipal board receives AI performance slides with no narrative on residual decision risk. What should the auditor emphasize?
Select an answer to reveal the explanation.
Short Explanation
You can't give the board only accuracy trends and data drift metrics in technical annexes and call it oversight. Procurement costs and vendor service levels don't tell governors about residual decision risk. Preprocessing controls and feature lineage for developers aren't a substitute for board-level risk narratives either.
Full Explanation
Municipal boards oversee AI programs that affect residents; performance slides without residual decision-risk narratives leave governors unable to weigh remaining harm, uncertainty, and control gaps. Executive supervision reporting should cover outputs, impacts, and residual decision risk—not only model accuracy trends and data drift metrics in technical validation annexes for review teams. The auditor should emphasize including residual risk narratives so the board can direct risk acceptance, mitigation funding, or pause decisions.
Providing only model accuracy trends and data drift metrics in technical validation annexes for review teams fails as biased reporting that undermines oversight. Presenting AI procurement costs and vendor service levels in quarterly financial oversight summaries for finance fails; these financial details do not automatically communicate residual decision risk or civic impact. Detailing data preprocessing controls and feature lineage records in engineering documentation for development staff fails by substituting technical engineering records for municipal context, residual risk, and local control effectiveness.
Exam caveat: supervision reporting completeness—outputs, impacts, residual risk—is an exam theme distinct from raw performance dashboards. Operational check: review the latest board AI packet for explicit residual decision-risk narrative, owners, and open issues; if only model accuracy trends and data drift metrics in technical annexes appear, the supervision report is incomplete.