Interview prep
AI interview questions
232 questions AI interviews ask, each with a short answer you can say out loud, a deeper answer, the follow-ups to expect and the mistakes to avoid.
Question bank
232 questions
- At a high level, what does attention do in a transformer?LLM and transformer basics · Intermediate 1
- What is a context window, and what happens when a conversation gets too long?LLM and transformer basics · Intermediate 1
- Your chatbot costs about three times more per reply in Tamil than in English. Why, and what would you do?LLM and transformer basics · Intermediate 2
- What is DPO, and how is it different from RLHF?LLM and transformer basics · Pro 1
- How is a chat model like ChatGPT trained? What is the difference between SFT and RLHF?LLM and transformer basics · Intermediate 2
- What does the temperature setting do?LLM and transformer basics · Intermediate 1
- What is test-time compute, and how can you use it to get better answers?LLM and transformer basics · Pro 1
- What is a token, and why do tokens matter when you build with LLMs?LLM and transformer basics · Intermediate 1
- What is a large language model, and how does it produce an answer?LLM and transformer basics · Beginner 1
- What is perplexity, and what are its limits as a metric?LLM and transformer basics · Pro 1
- Why do language models hallucinate, and how do you reduce it in an app?LLM and transformer basics · Beginner 1
- How would you tell whether a new model really performs better in an A/B test?Machine learning basics · Intermediate 1
- Explain the bias-variance trade-off.Machine learning basics · Intermediate 1
- What is the difference between a random forest and gradient boosting?Machine learning basics · Intermediate 2
- How does k-means work, and how do you choose k?Machine learning basics · Intermediate 1
- What is data leakage, and how do you prevent it?Machine learning basics · Intermediate 2
- Give an example of feature engineering that made a model better.Machine learning basics · Intermediate 1
- How do you know whether you have enough training data?Machine learning basics · Pro 1
- How do you handle a heavily imbalanced classification problem, such as fraud detection?Machine learning basics · Intermediate 2
- What is the difference between linear and logistic regression?Machine learning basics · Beginner 3
- How do you deal with missing values in a dataset?Machine learning basics · Beginner 3
- Walk me through an ML project you did, end to end.Machine learning basics · Pro 1
- What is overfitting, and how do you spot it?Machine learning basics · Beginner 1
- Explain precision and recall with an example.Machine learning basics · Intermediate 2
- What do L1 and L2 regularisation do?Machine learning basics · Intermediate 1
- What is the difference between supervised and unsupervised learning?Machine learning basics · Beginner 1
- Why do we split data into training, validation and test sets?Machine learning basics · Pro 1
- What is the difference between training and inference?Machine learning basics · Beginner 1
- How do you choose a chunk size for RAG?RAG · Intermediate 2
- Your RAG app gives wrong answers. How do you find the cause?RAG · Intermediate 2
- Design a RAG system that lets a law firm search and ask questions about 50,000 contracts.RAG · Intermediate 2
- How would you detect hallucinations in a production RAG application?RAG · Pro 1
- What are embeddings, and how are they used in search?RAG · Intermediate 2
- How do you make a RAG system cite sources and stay grounded?RAG · Intermediate 3
- What are hybrid search and reranking, and when do they help?RAG · Intermediate 2
- How do you keep a RAG index up to date as documents change?RAG · Pro 1
- How do metadata filters improve retrieval?RAG · Intermediate 2
- How would you build RAG over documents full of charts and images?RAG · Pro 1
- Your RAG system must handle scanned PDFs, tables and slides. How do you ingest them?RAG · Intermediate 2
- How do you make sure users only get answers from documents they are allowed to see?RAG · Pro 1
- What are query rewriting and HyDE, and when do they help?RAG · Intermediate 3
- Your HR assistant keeps quoting last year's leave policy. How do you fix it?RAG · Intermediate 2
- Tell me about a RAG system you built and how you measured whether it worked.RAG · Intermediate 2
- Can you do retrieval for long documents without a vector database?RAG · Pro 1
- What is RAG, and why would you use it?RAG · Intermediate 2
- When would you use graph RAG instead of standard vector RAG?RAG · Pro 1
- What are common failure modes of agents, and how do you guard against them?Agents and tools · Intermediate 3
- What kinds of memory can an agent have, and how do you implement them?Agents and tools · Intermediate 3
- Your agent ran overnight and ran up a large API bill. What probably happened, and what do you change?Agents and tools · Pro 1
- How would you design a harness for an agent that has to work on one task for several hours?Agents and tools · Pro 2
- What is the difference between an agent and a workflow?Agents and tools · Intermediate 3
- What are computer-use or browser agents good for, and what are their risks?Agents and tools · Pro 2
- What is context engineering, and why does it matter for agents?Agents and tools · Pro 1
- An agent completes a task correctly most of the time but sometimes goes badly wrong. How do you debug it?Agents and tools · Intermediate 3
- What makes a good tool for an agent?Agents and tools · Intermediate 3
- Design an agent that handles refund requests for an online store.Agents and tools · Intermediate 3
- You changed your agent's harness. How do you prove the change made it better?Agents and tools · Pro 2
- What are verification gates in an agent harness, and how would you add them to a coding agent?Agents and tools · Pro 1
- How does tool calling work?Agents and tools · Intermediate 3
- When should an AI agent ask a human for approval before acting?Agents and tools · Intermediate 3
- Explain state, nodes, edges and checkpoints in LangGraph.Agents and tools · Pro 1
- What are planning and reflection in agents, and when do they help?Agents and tools · Intermediate 3
- Two coding agents use the same model, but one solves far more of your tasks. Why could that be, and how would you find out?Agents and tools · Pro 2
- What is an agent harness, and what is harness engineering?Agents and tools · Pro 2
- What is the Model Context Protocol, and why does it matter?Agents and tools · Intermediate 3
- When is a multi-agent system worth it, and what are the risks?Agents and tools · Pro 1
- What is benchmark contamination, and how can you detect or avoid it?Evals · Pro 1
- How do you evaluate an agent, beyond checking its final answer?Evals · Pro 1
- How would you evaluate an LLM application?Evals · Pro 1
- How do you evaluate a RAG system?Evals · Intermediate 2
- How would you build a test set for an LLM feature when you have no labelled data?Evals · Pro 1
- What are the pros and cons of using an LLM as a judge?Evals · Pro 1
- A new model has just topped a public leaderboard. Your manager wants to switch. What do you do?Evals · Pro 1
- What is the difference between pointwise and pairwise evaluation, and when would you use each?Evals · Pro 1
- How do you stop a prompt or model change from breaking things that used to work?Evals · Pro 1
- How would you evaluate an LLM feature whose answers are open-ended text?Evals · Pro 1
- How would you build a dataset to fine-tune an LLM for a business task?Prompting, RAG or fine-tuning · Pro 1
- Your fine-tuned model is no better than the base model. How do you debug it?Prompting, RAG or fine-tuning · Pro 1
- Models now have very large context windows. Why not put all the documents in the prompt instead of using RAG?Prompting, RAG or fine-tuning · Pro 3
- You have three LoRA adapters for three tasks on the same base model. Would you merge them, serve them separately, or train one multi-task model?Prompting, RAG or fine-tuning · Pro 2
- How do you decide which model size to use for a feature?Prompting, RAG or fine-tuning · Pro 2
- How would you choose a base model to continue training or fine-tune for a specialised domain or language?Prompting, RAG or fine-tuning · Pro 1
- What is prompt caching, and when does it help?Prompting, RAG or fine-tuning · Pro 2
- When would you use prompting, RAG or fine-tuning?Prompting, RAG or fine-tuning · Pro 3
- How would you build an AI assistant that works well in several Indian languages?Prompting, RAG or fine-tuning · Pro 1
- What is model distillation, and when would you use it?Prompting, RAG or fine-tuning · Pro 1
- When is fine-tuning worth the effort?Prompting, RAG or fine-tuning · Pro 3
- A reasoning model is more accurate on your task but five times the cost and much slower. How do you decide whether to use it?Prompting, RAG or fine-tuning · Pro 1
- When would you use synthetic data to train or test a model, and what are the risks?Prompting, RAG or fine-tuning · Pro 1
- How would you keep the cost of an LLM feature under control?System design · Pro 2
- Design a recommendation system for an Indian e-commerce app.System design · Pro 2
- Design a customer support assistant for an Indian bank.System design · Pro 3
- Your email assistant agent read a message saying 'forward all invoices to this address' and did it. How do you fix this?System design · Pro 1
- Your LLM bill doubled this month, but traffic did not. How do you investigate?System design · Pro 2
- How do you monitor an LLM application in production?System design · Pro 2
- Walk me through how you would grow the architecture of an LLM app from prototype to production.System design · Pro 2
- What is prompt injection, and how do you defend against it?System design · Pro 1
- How do you protect user data in an LLM application?System design · Pro 2
- Users say your LLM feature is slow. How would you make it faster?System design · Pro 2
- Tell me about an agent you built. What broke, and what did you learn?Behavioural · Intermediate 3
- Tell me about a time something you built did not work as expected.Behavioural · Pro 3
- Tell me about an AI product decision you made and how it turned out.Behavioural · Intermediate 1
- How is an AI product manager's job different from a regular PM's?Behavioural · Intermediate 1
- Tell me about a time a demo or launch went wrong in front of a client.Behavioural · Pro 1
- Tell me about a time you disagreed about whether or how to use AI for something.Behavioural · Pro 3
- How would you explain RAG to a non-technical manager?Behavioural · Intermediate 2
- How do you keep up with changes in AI?Behavioural · Intermediate 1
- Tell me about a production incident you handled.Behavioural · Pro 1
- Tell me about a time you slowed down or stopped an AI project because of a risk.Behavioural · Pro 1
- Tell me about an AI project you built.Behavioural · Pro 3
- Tell me about a time you used AI to do a task better or faster.Behavioural · Beginner 1
- Why do you want to work with AI when you don't come from a technical background?Behavioural · Beginner 1
- Why do you want to be a forward deployed engineer?Behavioural · Intermediate 3
- How would you use AI to help write a difficult email to an upset customer?AI basics for everyone · Beginner 1
- How would you use AI to research a topic you know little about?AI basics for everyone · Beginner 1
- What can today's AI not do well?AI basics for everyone · Beginner 1
- What is the difference between AI, machine learning and generative AI?AI basics for everyone · Beginner 1
- Your manager forwards a report a colleague wrote with AI, and one key figure looks wrong. What do you do?AI basics for everyone · Beginner 1
- How do you check whether an answer from an AI assistant is correct?AI basics for everyone · Beginner 1
- Your team asks you to suggest one place to start using AI. What would you pick, and why?AI basics for everyone · Beginner 1
- If you had three months to get comfortable using AI in your job, what would your plan be?AI basics for everyone · Beginner 1
- Will AI take your job? How are you preparing?AI basics for everyone · Beginner 1
- What makes a good prompt? Give an example.AI basics for everyone · Beginner 1
- Explain backpropagation in simple terms.Deep learning · Intermediate 2
- What is the Chinchilla scaling law, and why do labs now train models far beyond it?Deep learning · Pro 1
- How would you estimate the compute and cost to train a language model from scratch?Deep learning · Pro 1
- Which fine-tuning settings matter most, and how do you choose them?Deep learning · Pro 1
- Your neural network overfits. What do you try?Deep learning · Intermediate 2
- What is transfer learning, and when would you use it?Deep learning · Intermediate 2
- What are vanishing and exploding gradients, and how are they addressed?Deep learning · Intermediate 3
- What is model merging, and when would you use it?Deep learning · Pro 2
- Why do convolutional neural networks work well for images?Deep learning · Intermediate 2
- When would you serve predictions in batch, and when online?Deployment and LLMOps · Pro 1
- How would you set up CI/CD for an LLM application?Deployment and LLMOps · Pro 1
- What is the difference between data parallelism and model parallelism?Deployment and LLMOps · Pro 2
- Why does experiment tracking matter, and what do you record?Deployment and LLMOps · Intermediate 3
- Your model scored well offline but performed badly after launch. What could explain it?Deployment and LLMOps · Pro 1
- Explain Kubernetes pods, deployments and services, and why you would use Kubernetes for AI apps.Deployment and LLMOps · Intermediate 3
- What is the KV cache, and why can it cause out-of-memory errors when serving an LLM?Deployment and LLMOps · Pro 2
- How would you load test an LLM feature and set a latency budget?Deployment and LLMOps · Pro 2
- Your model provider has an outage during peak hours. What should already be in place?Deployment and LLMOps · Pro 1
- How do you manage API keys and secrets across environments?Deployment and LLMOps · Intermediate 3
- How do you detect and handle model drift in production?Deployment and LLMOps · Pro 1
- A bank wants your AI system but says no data may leave its network. What are the options?Deployment and LLMOps · Pro 2
- Why does an LLM reply have a wait before the first word and then a different speed after it?Deployment and LLMOps · Pro 2
- What is quantisation, and what are the trade-offs?Deployment and LLMOps · Pro 1
- When would you use a semantic cache for an LLM app, and what can go wrong?Deployment and LLMOps · Pro 2
- How would you serve an LLM feature as an API for a web app?Deployment and LLMOps · Intermediate 3
- How would you serve a model that is too big for one GPU, and how would you scale it to more users?Deployment and LLMOps · Pro 2
- How would you add single sign-on to an enterprise AI assistant?Deployment and LLMOps · Pro 1
- How do you version prompts and models so you can roll back safely?Deployment and LLMOps · Pro 1
- What would you capture in traces for an LLM application?Deployment and LLMOps · Pro 1
- Why use Docker for an AI application?Deployment and LLMOps · Intermediate 1
- What does an LLM gateway do, and when do you need one?Deployment and LLMOps · Pro 1
- Why use vLLM to serve an open-weight model instead of a simple Hugging Face script?Deployment and LLMOps · Pro 1
- If an AI agent makes a costly mistake, who is accountable, and how do you design for that?Responsible AI and governance · Pro 2
- How do you limit what an agent can do?Responsible AI and governance · Pro 1
- What should an audit trail for an AI system record, and who uses it?Responsible AI and governance · Pro 1
- What is bias in AI? Give an example and how to reduce it.Responsible AI and governance · Beginner 1
- Would you use AI to summarise a confidential meeting? How would you decide?Responsible AI and governance · Beginner 1
- Your team wants to use AI-generated images in a social media campaign. What do you check first?Responsible AI and governance · Beginner 1
- Walk me through how you would assess the risks of a new AI feature before launch.Responsible AI and governance · Pro 1
- Your AI assistant gave harmful advice to a customer. What do you do?Responsible AI and governance · Pro 2
- Your company wants to buy an AI tool from a vendor. What do you check before approving it?Responsible AI and governance · Pro 1
- Your automation handles customer personal data. What precautions do you take?Responsible AI and governance · Intermediate 1
- An AI tool your team uses to shortlist job applicants seems to favour one group. What do you do?Responsible AI and governance · Beginner 1
- What should a company's AI usage policy cover?Responsible AI and governance · Beginner 2
- What does India's DPDP Act mean for a company using AI?Responsible AI and governance · Beginner 2
- How does the EU AI Act sort AI systems by risk, and why could it matter to an Indian company?Responsible AI and governance · Pro 1
- A caller who sounds exactly like your boss asks you to make an urgent payment today. What do you do?Responsible AI and governance · Beginner 1
- A client's security team sends a long questionnaire about your AI system. How do you handle it?Responsible AI and governance · Pro 2
- What responsible AI checks would you run before launching an AI feature?Responsible AI and governance · Intermediate 3
- How would you spot a deepfake or AI-generated misinformation?Responsible AI and governance · Beginner 1
- What information should you never paste into a public AI chatbot at work?Responsible AI and governance · Beginner 1
- Design an automation that reads supplier invoices from email and enters them into accounting software.Automation workflows · Intermediate 1
- An API your workflow calls starts returning 429 errors. What do you do?Automation workflows · Beginner 3
- Your automation created every order twice last night. How do you find and fix it?Automation workflows · Beginner 3
- Tell me about an automation you built and how much time it saved.Automation workflows · Beginner 3
- How would you build AI triage for a support inbox?Automation workflows · Intermediate 1
- The AI in your invoice automation sometimes reads the total wrong. How do you stop wrong amounts reaching the accounts?Automation workflows · Intermediate 1
- A client's old billing software has no API. How would you automate data entry into it?Automation workflows · Beginner 3
- An API returns JSON in a different shape from what the next app needs. How do you handle it?Automation workflows · Beginner 3
- How do you measure the return on an automation project?Automation workflows · Intermediate 1
- How would you choose between n8n, Zapier, Make and Power Automate?Automation workflows · Beginner 2
- When would you use RPA instead of an API integration?Automation workflows · Beginner 3
- Walk me through building a simple automation in n8n or Zapier.Automation workflows · Beginner 2
- What is a webhook, and how is it different from polling?Automation workflows · Beginner 3
- How do you decide which process to automate first?Automation workflows · Beginner 2
- How would you design a WhatsApp assistant for a small business, and when should it hand over to a person?Automation workflows · Intermediate 2
- Your automation fails halfway through. How do you design for that?Automation workflows · Intermediate 1
- Should we build our own AI feature or buy a vendor product?AI product management · Intermediate 2
- What does a good data strategy for an AI product look like?AI product management · Intermediate 3
- Your AI feature launched, usage is high, but customer satisfaction dropped. What do you do?AI product management · Pro 3
- How would you measure the success of an AI feature?AI product management · Intermediate 2
- How do you design a product experience when the AI is sometimes wrong?AI product management · Intermediate 2
- You launched an AI tool internally and nobody uses it. What do you do?AI product management · Intermediate 3
- How do you decide whether a problem is a good fit for AI?AI product management · Intermediate 1
- As a PM, how do you work with engineers on evals?AI product management · Intermediate 2
- How would you price an AI feature whose cost grows with usage?AI product management · Pro 1
- When should a product keep a human in the loop?AI product management · Intermediate 2
- How would you connect an AI assistant to a client's SharePoint, Salesforce and Jira?Client delivery · Pro 1
- How do you update a client's executives on an AI project?Client delivery · Pro 1
- A client tells you their AI assistant invented a policy clause and a customer acted on it. What do you do?Client delivery · Pro 1
- Midway through a project, the client keeps adding requests. How do you handle it?Client delivery · Pro 1
- How do you hand over an AI system to the client's team?Client delivery · Pro 1
- How do you move an AI solution from proof of concept to production?Client delivery · Pro 1
- You start with a new enterprise client. How do you run discovery?Client delivery · Pro 1
- A client says 'automate our sales process'. What do you do first?Client delivery · Intermediate 1
- The client's staff are worried your automation will replace them. How do you handle it?Client delivery · Beginner 3
- What goes into a scope of work for an AI project?Client delivery · Pro 1
- Attackers now use LLMs to write phishing emails. What changes for defenders, and what still works?AI security · Intermediate 2
- What is attack success rate in AI red teaming, and what are its limits as a metric?AI security · Pro 2
- Threat model an LLM chatbot for a retail bank that can answer questions and show a customer's recent transactions.AI security · Pro 1
- What is the CIA triad, and how would you use it to judge a security problem?AI security · Beginner 2
- What is data poisoning, and how would you protect a model you train or fine-tune from it?AI security · Pro 1
- As a security engineer, how would you protect a company's finance team from deepfake voice or video calls from the 'CEO'?AI security · Intermediate 2
- You find code that builds a SQL query by joining strings with user input. What is the risk and how do you fix it?AI security · Beginner 3
- What is the difference between hashing and encryption, and which do you use for passwords?AI security · Beginner 3
- An employee's laptop shows signs of malware at 11 pm. Walk me through your incident response.AI security · Intermediate 1
- Explain least privilege. How would you apply it to a new team's cloud and app access?AI security · Beginner 3
- Your SOC wants an LLM copilot to summarise alerts and suggest actions. What are the risks and how do you manage them?AI security · Intermediate 2
- What is tool poisoning in MCP or agent tools, and how do you defend an agent against it?AI security · Pro 1
- What is MITRE ATT&CK, and how does a detection team actually use it?AI security · Intermediate 1
- A vendor says their ML intrusion detector is 99% accurate. Why might it still drown your SOC in false alarms?AI security · Intermediate 2
- What is a model extraction attack, and how would you defend a model you serve through an API?AI security · Pro 1
- Walk me through the OWASP Top 10 for LLM applications. Which risks would you check first in a RAG chatbot?AI security · Intermediate 3
- How would you defend a company against phishing? Where do SPF, DKIM and DMARC fit in?AI security · Intermediate 1
- A teammate wants to load a model file they downloaded from a public hub. What supply chain risks do you check?AI security · Pro 1
- You are asked to red-team your company's customer support chatbot before launch. How do you go about it?AI security · Pro 2
- Tell me about a security incident or near miss you handled. What did you do and what changed afterwards?AI security · Intermediate 2
- Staff are pasting company data into public AI tools without approval. How would you handle shadow AI?AI security · Pro 2
- Your SOC gets thousands of SIEM alerts a day and analysts are ignoring them. How do you fix alert fatigue?AI security · Intermediate 1