A historical-society desk writes eighteen precious question-and-answer cards, trains until the model recites them, then fails on a rephrased nineteenth card. What experimental response fits this instruction-tuning overfit?
Select an answer to reveal the explanation.
Short Explanation
Eighteen cards recited perfectly, a rephrased nineteenth failed. That is memorization of a tiny set. Add diverse items, stop earlier, shrink the adapter, or do not adapt yet. Training longer on the same eighteen, naming overfit, or serving the recitation does not fix it.
Full Explanation
Reciting a tiny instruction set and failing a rephrase is memorization, not a successful adaptation. The experimental response is more diverse items, an earlier stop, a smaller adapter, or a decision not to adapt yet. Repeating the textbook name without changing the run, training longer on the same cards, or serving the memorized set does not fix the symptom. Associate practice treats the failure as a run decision.