Skip to main content

When is fine-tuning worth the effort?

Prompting, RAG or fine-tuning · Pro 3

Short answer

When a narrow, repeated task needs behaviour that prompting cannot reliably produce, you have hundreds to thousands of high-quality examples, and an eval set to prove the gain. Common wins: a strict output format, a house style, a specialised classification, or making a smaller model match a larger one to cut cost and latency.

Deeper answer

Fine-tuning has real costs: collecting and cleaning data, training runs, evaluating, hosting or paying for the tuned model, and redoing it when the base model improves. A newer base model may make your fine-tune unnecessary.

Before fine-tuning, try better prompts with examples, structured output, and retrieval. If you do fine-tune, keep a held-out test set, compare against the best prompted baseline, and watch for losing general abilities the task still needs.

What a strong answer covers

Answer it out loud in the mock interview about 1.5 min

Follow-ups to expect

Common mistakes

Learn it

Prompting, RAG or fine-tuning

Today's AI turns are used

Lessons, roadmaps, videos, practice cards and the code playground stay free with your account, with no limit.