Threat model an LLM chatbot for a retail bank that can answer questions and show a customer's recent transactions.
AI security · Pro 1
Short answer
I would draw the data flow: app, login, chatbot service, model provider, policy documents and the transactions API. For each part I ask what could go wrong, using STRIDE plus AI threats: prompt injection, one customer seeing another's data, data sent to the provider, wrong financial advice, and abuse. Each threat gets a control, an owner and a test.
Deeper answer
Key trust boundaries: the user's message, retrieved documents, the model provider and the transactions API. Main threats and controls: spoofing is handled by the bank's existing login and session checks, never by the model; information disclosure is prevented by having the transactions tool take the account ID from the verified session, not from the model's output; tampering and injection are limited by keeping the bot read-only, with no money movement; repudiation is handled by audit logs of prompts, tool calls and answers; denial of service and cost abuse by rate limits and token caps.
AI-specific: system prompt leakage, hallucinated rates or fees (ground answers in approved documents and cite them), data residency and retention with the provider, and RBI and DPDP Act obligations reviewed with compliance. MITRE ATLAS helps list attacks on the model itself.
What a strong answer covers
- Draws a data flow with trust boundaries
- Uses STRIDE or a structured method
- AI threats: injection, data leakage across customers, hallucination
- Controls in code: session-bound account ID, read-only tools
- Audit logs, rate limits and compliance
Answer it out loud in the mock interview about 2 min
Follow-ups to expect
- Why must the account ID come from the session and not from the model?
- What changes if the bot can also make payments?
Common mistakes
- Letting the model decide which customer's data to fetch
- Listing threats without owners, controls and tests
Learn it
- Attackers now use LLMs to write phishing emails. What changes for defenders, and what still works?
- What is attack success rate in AI red teaming, and what are its limits as a metric?
- What is the CIA triad, and how would you use it to judge a security problem?
- What is data poisoning, and how would you protect a model you train or fine-tune from it?
- As a security engineer, how would you protect a company's finance team from deepfake voice or video calls from the 'CEO'?
- You find code that builds a SQL query by joining strings with user input. What is the risk and how do you fix it?
- What is the difference between hashing and encryption, and which do you use for passwords?
- An employee's laptop shows signs of malware at 11 pm. Walk me through your incident response.
- Explain least privilege. How would you apply it to a new team's cloud and app access?
- Your SOC wants an LLM copilot to summarise alerts and suggest actions. What are the risks and how do you manage them?
- What is tool poisoning in MCP or agent tools, and how do you defend an agent against it?
- What is MITRE ATT&CK, and how does a detection team actually use it?
- A vendor says their ML intrusion detector is 99% accurate. Why might it still drown your SOC in false alarms?
- What is a model extraction attack, and how would you defend a model you serve through an API?
- Walk me through the OWASP Top 10 for LLM applications. Which risks would you check first in a RAG chatbot?
- How would you defend a company against phishing? Where do SPF, DKIM and DMARC fit in?
- A teammate wants to load a model file they downloaded from a public hub. What supply chain risks do you check?
- You are asked to red-team your company's customer support chatbot before launch. How do you go about it?
- Tell me about a security incident or near miss you handled. What did you do and what changed afterwards?
- Staff are pasting company data into public AI tools without approval. How would you handle shadow AI?
- Your SOC gets thousands of SIEM alerts a day and analysts are ignoring them. How do you fix alert fatigue?