The same animal-control desk used to paste all 80 stray-hold PDFs into each request. The context window overflowed and the bill exploded. Which approach should replace that pattern?
Select an answer to reveal the explanation.
Short Explanation
Think of stuffing all 80 PDFs into every request until the window overflows. Retrieve a few relevant passages instead. Daily fine-tuning, or dropping the PDFs, is not the application fix.
Full Explanation
Retrieval should replace packing every source document into every prompt. Stuffing 80 PDFs overflows the window and multiplies cost. Daily fine-tuning on the unused full corpus, or dropping the PDFs, is not the application fix.