Skip to main content

When would you use synthetic data to train or test a model, and what are the risks?

Prompting, RAG or fine-tuning · Pro 1

Short answer

When real labelled data is scarce, slow or private: to grow rare classes, cover edge cases, translate into low-resource languages, or label real inputs with a strong model. The risks are errors in generated data, unrealistic language, bias copied from the generator, and model collapse if it replaces real data. Always filter it and test on real data.

Deeper answer

The best value often comes from keeping inputs real and letting a strong model produce the labels, because the data still looks like what users send. Paraphrasing real rare examples is another safe win.

Verification is the heart of it: run generated code or SQL against tests, use an LLM judge with written rules, filter duplicates and length outliers, and read a random sample by hand. Keep real data in the training mix, never test on synthetic data, and record which model generated which data, because provider terms may forbid training competing models on their outputs.

What a strong answer covers

Answer it out loud in the mock interview about 1.5 min

Follow-ups to expect

Common mistakes

Learn it

Synthetic data and distillation: training with model-made data

Today's AI turns are used

Lessons, roadmaps, videos, practice cards and the code playground stay free with your account, with no limit.