Interview prep
Machine Learning Engineer interview questions
39 questions a Machine Learning Engineer interview is likely to ask, with short answers you can say out loud. Then practice them in a timed mock interview.
39 questions
- What is DPO, and how is it different from RLHF?LLM and transformer basics · Pro 1
- How is a chat model like ChatGPT trained? What is the difference between SFT and RLHF?LLM and transformer basics · Intermediate 2
- What is perplexity, and what are its limits as a metric?LLM and transformer basics · Pro 1
- How would you tell whether a new model really performs better in an A/B test?Machine learning basics · Intermediate 1
- Explain the bias-variance trade-off.Machine learning basics · Intermediate 1
- What is the difference between a random forest and gradient boosting?Machine learning basics · Intermediate 2
- How does k-means work, and how do you choose k?Machine learning basics · Intermediate 1
- What is data leakage, and how do you prevent it?Machine learning basics · Intermediate 2
- Give an example of feature engineering that made a model better.Machine learning basics · Intermediate 1
- How do you know whether you have enough training data?Machine learning basics · Pro 1
- How do you handle a heavily imbalanced classification problem, such as fraud detection?Machine learning basics · Intermediate 2
- What is the difference between linear and logistic regression?Machine learning basics · Beginner 3
- How do you deal with missing values in a dataset?Machine learning basics · Beginner 3
- Walk me through an ML project you did, end to end.Machine learning basics · Pro 1
- What is overfitting, and how do you spot it?Machine learning basics · Beginner 1
- Explain precision and recall with an example.Machine learning basics · Intermediate 2
- What do L1 and L2 regularisation do?Machine learning basics · Intermediate 1
- What is the difference between supervised and unsupervised learning?Machine learning basics · Beginner 1
- Why do we split data into training, validation and test sets?Machine learning basics · Pro 1
- How would you build a dataset to fine-tune an LLM for a business task?Prompting, RAG or fine-tuning · Pro 1
- Your fine-tuned model is no better than the base model. How do you debug it?Prompting, RAG or fine-tuning · Pro 1
- You have three LoRA adapters for three tasks on the same base model. Would you merge them, serve them separately, or train one multi-task model?Prompting, RAG or fine-tuning · Pro 2
- How would you choose a base model to continue training or fine-tune for a specialised domain or language?Prompting, RAG or fine-tuning · Pro 1
- What is model distillation, and when would you use it?Prompting, RAG or fine-tuning · Pro 1
- When would you use synthetic data to train or test a model, and what are the risks?Prompting, RAG or fine-tuning · Pro 1
- Design a recommendation system for an Indian e-commerce app.System design · Pro 2
- Explain backpropagation in simple terms.Deep learning · Intermediate 2
- What is the Chinchilla scaling law, and why do labs now train models far beyond it?Deep learning · Pro 1
- How would you estimate the compute and cost to train a language model from scratch?Deep learning · Pro 1
- Which fine-tuning settings matter most, and how do you choose them?Deep learning · Pro 1
- Your neural network overfits. What do you try?Deep learning · Intermediate 2
- What is transfer learning, and when would you use it?Deep learning · Intermediate 2
- What are vanishing and exploding gradients, and how are they addressed?Deep learning · Intermediate 3
- What is model merging, and when would you use it?Deep learning · Pro 2
- Why do convolutional neural networks work well for images?Deep learning · Intermediate 2
- When would you serve predictions in batch, and when online?Deployment and LLMOps · Pro 1
- Why does experiment tracking matter, and what do you record?Deployment and LLMOps · Intermediate 3
- Your model scored well offline but performed badly after launch. What could explain it?Deployment and LLMOps · Pro 1
- How do you detect and handle model drift in production?Deployment and LLMOps · Pro 1