A ferry-wait framework prints a glowing F1 that nobody can reproduce by hand on the same cells. What mitigations should testers pick for that defective evaluation implementation?
Select an answer to reveal the explanation.
Short Explanation
A glowing F1 that nobody can reproduce by hand on the same cells is a defective evaluation implementation. Mitigate it with reviews of the framework’s evaluation code and a cross-check against a manual benchmark. Trusting the printed F1, a live canary, and a metamorphic follow-up miss those mitigations.
Full Explanation
A defective framework evaluation is mitigated by code review plus a manual-benchmark cross-check. Trusting the printed F1, a canary, or a metamorphic follow-up miss those mitigations.