Feature engineering
Turn raw records into features that help models: aggregates over time, ratios, date parts, encodings for categories, text and location features, while avoiding leakage and keeping training and serving consistent.
Intermediate 1 · LLM builderabout 5 hours7 sections
Quick answer
Feature engineering turns raw records into inputs a model can learn from, such as counts over the last 30 days, ratios, date parts and encoded categories, without using future data.
Why it matters
In tabular ML, better features beat fancier models. Experienced ML engineers spend most of their modelling time here. Doing it without leaking future information, and computing features the same way in production, is what separates real-world results from notebook results.
Sign up free to read the whole lesson
The rest of this lesson: 7 parts, video lessons, the best course, practice and a quick check. It is free, takes a few seconds and needs no card.
Accounts are for learners aged 18 and over. Under 18? The quick answer and the first part of every lesson stay open: browse lessons by topic.
Lessons on Machine Learning Engineer0 of 31 done
- 1Variables, loops and functions in Python
- 2Tables with pandas
- 3Maths for machine learning
- 4Statistics for machine learning
- 5NumPy and plotting
- 6Regression
- 7Classification
- 8Trees and gradient boosting
- 9Unsupervised learning
- 10Feature engineering
- 11Cross-validation and leakage
- 12Choosing a metric
- 13Neural networks
- 14PyTorch
- 15CNNs for images
- 16Transformers
- 17How a chat model is made: pre-training, SFT and preference tuning
- 18Model size and scaling laws: parameters, training data and compute
- 19Perplexity and cross-entropy: how language models are measured
- 20How a model picks its next word: temperature, top-p and top-k
- 21How fine-tuning works: data, training and what can go wrong
- 22LoRA, QLoRA and the GPU memory maths
- 23Fine-tuning in practice: tools, settings and reading the loss curve
- 24Model merging: combining fine-tuned models into one
- 25Synthetic data and distillation: training with model-made data
- 26Building a training dataset: quality, coverage and quantity
- 27Experiment tracking and model registry
- 28Serving a model
- 29Monitoring and drift
- 30Data versioning
- 31ML interviews
Related
On the roadmap: Machine Learning Engineer
Machine learningIntermediate 1: LLM builderVideo lessonsFeature engineeringFeatureData leakageCross-validation