A company is conducting a red-team exercise against their internal LLM-based customer service chatbot. The red team successfully exfiltrates the system prompt by asking the model to 'repeat all previous instructions.' This represents which category of AI attack?
Select an answer to reveal the explanation.
Short Explanation and Infographic
Here's the deal — c is correct because asking the model to 'repeat all previous instructions' is a classic direct prompt injection attack where the user crafts input specifically to override or extract the model's system prompt/instructions. This is a jailbreak technique targeting system prompt disclosure.
Full explanation below image
Full Explanation
C is correct because asking the model to 'repeat all previous instructions' is a classic direct prompt injection attack where the user crafts input specifically to override or extract the model's system prompt/instructions. This is a jailbreak technique targeting system prompt disclosure. A is incorrect because model inversion attacks attempt to reconstruct training data from model outputs through repeated queries. B is incorrect because indirect prompt injection uses content from external sources retrieved by the model, not direct user messages. D is incorrect because training data poisoning corrupts the model's training data to affect its behavior, which is a supply chain attack distinct from prompt manipulation during inference.