Skip to main content

How do you know whether you have enough training data?

Machine learning basics · Pro 1

Short answer

There is no fixed number; it depends on the task, base model and method. Start with 50 to 100 excellent examples and check they help. Then train on 25%, 50% and 100% of the data and score each on the same test set. A rising curve says collect more; a flat one says improve quality or coverage.

Deeper answer

Simple tasks and strong base models need less data; light methods like LoRA work with hundreds to thousands of examples, while full fine-tuning usually wants far more. Gains usually shrink as the set grows.

If a small set shows no gain at all, more of the same rarely fixes it: check the format, prompt and settings. Look at scores by segment too, since a flat overall curve can hide one weak group, such as a second language, that needs targeted examples.

What a strong answer covers

Answer it out loud in the mock interview about 1 min

Follow-ups to expect

Common mistakes

Learn it

Building a training dataset: quality, coverage and quantity

Today's AI turns are used

Lessons, roadmaps, videos, practice cards and the code playground stay free with your account, with no limit.