Interview prep
Forward Deployed Engineer (FDE) interview questions
98 questions a Forward Deployed Engineer (FDE) interview is likely to ask, with short answers you can say out loud. Then practice them in a timed mock interview.
98 questions
- What is a context window, and what happens when a conversation gets too long?LLM and transformer basics · Intermediate 1
- Your chatbot costs about three times more per reply in Tamil than in English. Why, and what would you do?LLM and transformer basics · Intermediate 2
- What does the temperature setting do?LLM and transformer basics · Intermediate 1
- What is a token, and why do tokens matter when you build with LLMs?LLM and transformer basics · Intermediate 1
- How do you choose a chunk size for RAG?RAG · Intermediate 2
- Your RAG app gives wrong answers. How do you find the cause?RAG · Intermediate 2
- Design a RAG system that lets a law firm search and ask questions about 50,000 contracts.RAG · Intermediate 2
- How would you detect hallucinations in a production RAG application?RAG · Pro 1
- What are embeddings, and how are they used in search?RAG · Intermediate 2
- How do you make a RAG system cite sources and stay grounded?RAG · Intermediate 3
- What are hybrid search and reranking, and when do they help?RAG · Intermediate 2
- How do you keep a RAG index up to date as documents change?RAG · Pro 1
- How do you make sure users only get answers from documents they are allowed to see?RAG · Pro 1
- What are query rewriting and HyDE, and when do they help?RAG · Intermediate 3
- Tell me about a RAG system you built and how you measured whether it worked.RAG · Intermediate 2
- Can you do retrieval for long documents without a vector database?RAG · Pro 1
- What is RAG, and why would you use it?RAG · Intermediate 2
- What are common failure modes of agents, and how do you guard against them?Agents and tools · Intermediate 3
- What kinds of memory can an agent have, and how do you implement them?Agents and tools · Intermediate 3
- Your agent ran overnight and ran up a large API bill. What probably happened, and what do you change?Agents and tools · Pro 1
- How would you design a harness for an agent that has to work on one task for several hours?Agents and tools · Pro 2
- What is the difference between an agent and a workflow?Agents and tools · Intermediate 3
- What is context engineering, and why does it matter for agents?Agents and tools · Pro 1
- An agent completes a task correctly most of the time but sometimes goes badly wrong. How do you debug it?Agents and tools · Intermediate 3
- What makes a good tool for an agent?Agents and tools · Intermediate 3
- Design an agent that handles refund requests for an online store.Agents and tools · Intermediate 3
- You changed your agent's harness. How do you prove the change made it better?Agents and tools · Pro 2
- What are verification gates in an agent harness, and how would you add them to a coding agent?Agents and tools · Pro 1
- How does tool calling work?Agents and tools · Intermediate 3
- When should an AI agent ask a human for approval before acting?Agents and tools · Intermediate 3
- Explain state, nodes, edges and checkpoints in LangGraph.Agents and tools · Pro 1
- What are planning and reflection in agents, and when do they help?Agents and tools · Intermediate 3
- Two coding agents use the same model, but one solves far more of your tasks. Why could that be, and how would you find out?Agents and tools · Pro 2
- What is an agent harness, and what is harness engineering?Agents and tools · Pro 2
- What is the Model Context Protocol, and why does it matter?Agents and tools · Intermediate 3
- What is benchmark contamination, and how can you detect or avoid it?Evals · Pro 1
- How would you evaluate an LLM application?Evals · Pro 1
- How do you evaluate a RAG system?Evals · Intermediate 2
- How would you build a test set for an LLM feature when you have no labelled data?Evals · Pro 1
- What are the pros and cons of using an LLM as a judge?Evals · Pro 1
- A new model has just topped a public leaderboard. Your manager wants to switch. What do you do?Evals · Pro 1
- What is the difference between pointwise and pairwise evaluation, and when would you use each?Evals · Pro 1
- How do you stop a prompt or model change from breaking things that used to work?Evals · Pro 1
- How would you evaluate an LLM feature whose answers are open-ended text?Evals · Pro 1
- How do you decide which model size to use for a feature?Prompting, RAG or fine-tuning · Pro 2
- What is prompt caching, and when does it help?Prompting, RAG or fine-tuning · Pro 2
- How would you build an AI assistant that works well in several Indian languages?Prompting, RAG or fine-tuning · Pro 1
- How would you keep the cost of an LLM feature under control?System design · Pro 2
- Design a customer support assistant for an Indian bank.System design · Pro 3
- Your email assistant agent read a message saying 'forward all invoices to this address' and did it. How do you fix this?System design · Pro 1
- Your LLM bill doubled this month, but traffic did not. How do you investigate?System design · Pro 2
- How do you monitor an LLM application in production?System design · Pro 2
- Walk me through how you would grow the architecture of an LLM app from prototype to production.System design · Pro 2
- What is prompt injection, and how do you defend against it?System design · Pro 1
- How do you protect user data in an LLM application?System design · Pro 2
- Users say your LLM feature is slow. How would you make it faster?System design · Pro 2
- Tell me about an agent you built. What broke, and what did you learn?Behavioural · Intermediate 3
- Tell me about a time something you built did not work as expected.Behavioural · Pro 3
- Tell me about a time a demo or launch went wrong in front of a client.Behavioural · Pro 1
- Tell me about a time you disagreed about whether or how to use AI for something.Behavioural · Pro 3
- How would you explain RAG to a non-technical manager?Behavioural · Intermediate 2
- How do you keep up with changes in AI?Behavioural · Intermediate 1
- Tell me about an AI project you built.Behavioural · Pro 3
- Why do you want to be a forward deployed engineer?Behavioural · Intermediate 3
- How would you set up CI/CD for an LLM application?Deployment and LLMOps · Pro 1
- What is the difference between data parallelism and model parallelism?Deployment and LLMOps · Pro 2
- Explain Kubernetes pods, deployments and services, and why you would use Kubernetes for AI apps.Deployment and LLMOps · Intermediate 3
- What is the KV cache, and why can it cause out-of-memory errors when serving an LLM?Deployment and LLMOps · Pro 2
- How would you load test an LLM feature and set a latency budget?Deployment and LLMOps · Pro 2
- Your model provider has an outage during peak hours. What should already be in place?Deployment and LLMOps · Pro 1
- How do you manage API keys and secrets across environments?Deployment and LLMOps · Intermediate 3
- A bank wants your AI system but says no data may leave its network. What are the options?Deployment and LLMOps · Pro 2
- Why does an LLM reply have a wait before the first word and then a different speed after it?Deployment and LLMOps · Pro 2
- When would you use a semantic cache for an LLM app, and what can go wrong?Deployment and LLMOps · Pro 2
- How would you serve an LLM feature as an API for a web app?Deployment and LLMOps · Intermediate 3
- How would you serve a model that is too big for one GPU, and how would you scale it to more users?Deployment and LLMOps · Pro 2
- How would you add single sign-on to an enterprise AI assistant?Deployment and LLMOps · Pro 1
- What would you capture in traces for an LLM application?Deployment and LLMOps · Pro 1
- Why use Docker for an AI application?Deployment and LLMOps · Intermediate 1
- What does an LLM gateway do, and when do you need one?Deployment and LLMOps · Pro 1
- Why use vLLM to serve an open-weight model instead of a simple Hugging Face script?Deployment and LLMOps · Pro 1
- How do you limit what an agent can do?Responsible AI and governance · Pro 1
- What should an audit trail for an AI system record, and who uses it?Responsible AI and governance · Pro 1
- Your company wants to buy an AI tool from a vendor. What do you check before approving it?Responsible AI and governance · Pro 1
- Your automation handles customer personal data. What precautions do you take?Responsible AI and governance · Intermediate 1
- A client's security team sends a long questionnaire about your AI system. How do you handle it?Responsible AI and governance · Pro 2
- Your AI feature launched, usage is high, but customer satisfaction dropped. What do you do?AI product management · Pro 3
- How would you measure the success of an AI feature?AI product management · Intermediate 2
- You launched an AI tool internally and nobody uses it. What do you do?AI product management · Intermediate 3
- As a PM, how do you work with engineers on evals?AI product management · Intermediate 2
- How would you connect an AI assistant to a client's SharePoint, Salesforce and Jira?Client delivery · Pro 1
- How do you update a client's executives on an AI project?Client delivery · Pro 1
- A client tells you their AI assistant invented a policy clause and a customer acted on it. What do you do?Client delivery · Pro 1
- Midway through a project, the client keeps adding requests. How do you handle it?Client delivery · Pro 1
- How do you hand over an AI system to the client's team?Client delivery · Pro 1
- How do you move an AI solution from proof of concept to production?Client delivery · Pro 1
- You start with a new enterprise client. How do you run discovery?Client delivery · Pro 1
- What goes into a scope of work for an AI project?Client delivery · Pro 1