RAG: knowledge that is large, private, or changes often; needs citations and access control; cheapest way to add facts.
Fine-tuning: change behavior (style, format, domain reasoning, tool-use patterns) or distill into a smaller, faster model; poor at injecting fast-changing facts.
Long context: small or one-off document sets where simplicity matters; costs more per request, adds latency, and accuracy can drop for details in the middle.
They combine: fine-tune for behavior, RAG for knowledge, long context for a few key documents. Start with the cheapest option and measure.
Loading…