A company exposes its proprietary pricing model through a public inference API. Monitoring shows one client account sending millions of systematically varied queries and storing every response. Which threat does this pattern most indicate, and which control most directly reduces it?
Select an answer to reveal the explanation.
Short Explanation
Someone feeding your model millions of carefully varied questions and saving every answer is building a knock-off of your model. That's model extraction, and you starve it by limiting how many queries each client gets and watching for that probing pattern. The trap is calling it a capacity problem, because scaling up just hands the copycat more answers faster.
Full Explanation
Model extraction, sometimes called model stealing, uses large numbers of crafted queries and the resulting outputs to train a substitute model that approximates the target's behavior, undermining the owner's intellectual property and enabling further attacks offline. The systematic variation of inputs and wholesale recording of responses are the signature. Per-client rate limits and quotas raise the cost of collecting enough samples, and monitoring for unusual query volume and input coverage lets the team detect and suspend the account; returning less detailed outputs further reduces what each query reveals. Membership inference also uses queries, but its goal is to learn whether specific records were in the training data, which does not match an attacker trying to map the whole input space. Data poisoning targets training data, and inference queries do not change a deployed model unless it learns online; schema checks on queries would not stop extraction anyway. Treating the pattern as a capacity problem and autoscaling would keep the API responsive while giving the attacker every answer faster. Exam caveat: extraction threatens confidentiality of the model, while inference attacks threaten privacy of the training data. Operational check: review per-account query volumes and alert on clients whose request patterns cover the input space systematically.