Product teams notice over-refusal on benign requests. Best response?

Question

Accepted Answer

Measure with evals, refine prompts/policies carefully, without broadly disabling safety for harmful categories — Tune over-refusals with evals — don't solve it by turning off safety for everything.

Answer

Disable all refusals globally

Answer

Jailbreak the model in production

Answer

Ignore users

Product teams notice over-refusal on benign requests. Best response?

Short Explanation and Infographic

Full Explanation