Skip to main content

Threat model an LLM chatbot for a retail bank that can answer questions and show a customer's recent transactions.

AI security · Pro 1

Short answer

I would draw the data flow: app, login, chatbot service, model provider, policy documents and the transactions API. For each part I ask what could go wrong, using STRIDE plus AI threats: prompt injection, one customer seeing another's data, data sent to the provider, wrong financial advice, and abuse. Each threat gets a control, an owner and a test.

Deeper answer

Key trust boundaries: the user's message, retrieved documents, the model provider and the transactions API. Main threats and controls: spoofing is handled by the bank's existing login and session checks, never by the model; information disclosure is prevented by having the transactions tool take the account ID from the verified session, not from the model's output; tampering and injection are limited by keeping the bot read-only, with no money movement; repudiation is handled by audit logs of prompts, tool calls and answers; denial of service and cost abuse by rate limits and token caps.

AI-specific: system prompt leakage, hallucinated rates or fees (ground answers in approved documents and cite them), data residency and retention with the provider, and RBI and DPDP Act obligations reviewed with compliance. MITRE ATLAS helps list attacks on the model itself.

What a strong answer covers

Answer it out loud in the mock interview about 2 min

Follow-ups to expect

Common mistakes

Learn it

Threat model an AI system

Practice AI security questions

More on this topic

Today's AI turns are used

Lessons, roadmaps, videos, practice cards and the code playground stay free with your account, with no limit.