Quiz 15 Question 18 of 20

A team is migrating from claude-3-sonnet-20240229 to claude-3-5-sonnet-20241022. During regression testing, they discover that 8% of previously passing test cases now produce different outputs — not wrong outputs, just different phrasing or structure. The PM wants to declare the migration failed due to behavioral change. How should the architect respond?

Select an answer to reveal the explanation.

Motivation