A red team has demonstrated that an attacker can embed hidden instructions inside a document that a user uploads to a Copilot-powered assistant, causing the assistant to perform unauthorized actions. What type of attack is this, and what Azure AI Content Safety feature mitigates it?
Select an answer to reveal the explanation.
Short Explanation
Here's the deal — embedding hidden instructions in a document that a Copilot-powered assistant processes is an indirect prompt injection attack, not a direct jailbreak in the user message. Azure AI Content Safety's Prompt Shield document analysis mode scans documents and grounding content for injected instructions before the assistant acts, so it mitigates this attack vector.
Full Explanation
The correct answer is indirect prompt injection mitigated by Prompt Shield for documents because embedding malicious instructions inside documents that an AI assistant processes is called an indirect prompt injection attack, as opposed to a direct jailbreak in the user message. Azure AI Content Safety's Prompt Shield has a document analysis mode that scans documents and other grounding content for injected instructions before the AI processes them, mitigating this attack vector. The jailbreak attack with groundedness detection is wrong because jailbreak attacks are direct user-message attacks, and groundedness detection checks factual accuracy, not injection. The data poisoning attack with custom categories is wrong because data poisoning targets training data, and custom categories detect specific content terms. The model extraction attack with protected material detection is wrong because model extraction attempts to steal model weights or outputs, and protected material detection checks for copyright infringement.