An agent batch-processes 500 files per run and is constrained to only modify files in the /src directory. During evaluation, automated scanning reveals that 3 out of 500 files modified in the last run were in the /config directory. What is the correct evaluation and remediation sequence?
Select an answer to reveal the explanation.
Short Explanation and Infographic
If a contractor installs drywall in three rooms they were not hired to touch, you do not call it a 0.6% error rate and move on — you undo the work, figure out why it happened, and update the contract. On the exam: constraint violations have no acceptable tolerance; they require rollback, classification as a constraint violation, and instruction revision.
Full explanation below image
Full Explanation
Constraint violations are categorical failures, not statistical ones. Even a 0.6% rate (3 of 500) means the agent is operating outside its defined boundaries, which can have downstream effects (corrupted configs, policy violations, audit failures) that are disproportionate to the volume. The correct sequence (option B) is: halt acceptance of the results, roll back the unauthorized changes, classify the failure type (scope constraint violation), and revise the agent's instructions to enforce the scope boundary more explicitly — for example, by adding a pre-write check that validates the target path before any modification.
Option A is incorrect because constraint violations do not have acceptable error tolerances. Unlike quality metrics where some variance is normal, scope boundaries are hard limits. Tolerating even a small rate of violations means the constraint is not actually enforced — it is aspirational.
Option C (post-run cleanup script) is better than option A but is still a workaround. It adds a reactive cleanup step rather than fixing the agent's behavior, means violations do occur and must be discovered before cleanup, and adds complexity. More importantly, it does not revise the instruction to prevent future violations. Root cause remediation is always preferred over downstream correction.
Option D (reducing batch size) does not address the root cause. The agent violates scope because its instructions do not enforce it — not because it processes too many files at once. Smaller batches reduce productivity without fixing the constraint-enforcement gap.