When is RAG preferable to stuffing many few-shot examples into ever…

Question

When is RAG preferable to stuffing many few-shot examples into every prompt?

Accepted Answer

When knowledge is large/dynamic and should be retrieved per query rather than embedded wholesale each time — Huge changing knowledge bases want RAG; few-shot is for teaching format and a few patterns.

Answer

Never; few-shot always scales infinitely

Answer

Only when offline forever

Answer

When you want higher cost with no benefit

When is RAG preferable to stuffing many few-shot examples into every prompt?

Short Explanation and Infographic

Full Explanation