Skip to main content

When would you use prompting, RAG or fine-tuning?

Prompting, RAG or fine-tuning · Pro 3

Short answer

Start with prompting: it is fastest and cheapest to change. Add RAG when the model needs knowledge it lacks, especially private or changing information. Consider fine-tuning when you need a consistent behaviour, style or format that prompting cannot reach, have many good examples, and can evaluate the result.

Deeper answer

The approaches solve different problems. RAG adds knowledge at question time and keeps it current. Fine-tuning changes behaviour: tone, output format, a narrow skill, or getting a smaller, cheaper model to match a bigger one on one task. It is a poor way to add facts that change, because you must retrain to update them.

They also combine: a fine-tuned model can still use RAG. A strong answer mentions evaluation first (you cannot choose without a test set), the cost of maintaining training data, and the order: prompt, then retrieval, then fine-tuning, moving on only when measurements show the simpler step is not enough.

What a strong answer covers

Answer it out loud in the mock interview about 1.5 min

Follow-ups to expect

Common mistakes

Learn it

Prompting, RAG or fine-tuning

Today's AI turns are used

Lessons, roadmaps, videos, practice cards and the code playground stay free with your account, with no limit.