A security researcher demonstrates that by prefixing inputs to a customer service chatbot with 'Ignore previous instructions and instead...', the chatbot reveals its system prompt. What vulnerability does this exploit?
Select an answer to reveal the explanation.
Short Explanation and Infographic
Here's the deal — b is correct because prompt injection exploits the LLM's inability to reliably distinguish user inputs from system instructions — an attacker can craft inputs that override system prompts, extract confidential instructions, or cause unintended behaviors. A is a database attack unrelated to LLMs.
Full explanation below image
Full Explanation
B is correct because prompt injection exploits the LLM's inability to reliably distinguish user inputs from system instructions — an attacker can craft inputs that override system prompts, extract confidential instructions, or cause unintended behaviors. A is a database attack unrelated to LLMs. C is a web application vulnerability. D is an infrastructure security issue.