Skip to main content

Your fine-tuned model is no better than the base model. How do you debug it?

Prompting, RAG or fine-tuning · Pro 1

Short answer

First check the pipeline: can the model overfit 20 examples? If not, check data format, masking and the chat template. Then read the loss curves: flat means the learning rate is too low or labels are wrong; spikes mean it is too high; rising validation loss means overfitting. Finally, compare on a locked test set against a good prompt.

Deeper answer

I would read a sample of training examples for errors and inconsistency, and confirm the template used in training matches the one used at inference, a common silent failure. I would change one setting at a time: learning rate first, then epochs, then batch size with gradient accumulation if memory is tight.

If 50 to 100 good examples show no gain at all, more data rarely helps; the setup is usually wrong. If gains appear but lag in one segment, I would add data for that segment rather than tune further.

What a strong answer covers

Answer it out loud in the mock interview about 1.5 min

Follow-ups to expect

Common mistakes

Learn it

Fine-tuning in practice: tools, settings and reading the loss curve

Today's AI turns are used

Lessons, roadmaps, videos, practice cards and the code playground stay free with your account, with no limit.