Skip to main content

A bank wants your AI system but says no data may leave its network. What are the options?

Deployment and LLMOps · Pro 2

Short answer

Options include a private deployment of a hosted model in the bank's cloud tenancy and region, such as Azure OpenAI or Bedrock in its own account, if policy allows; or self-hosting open-weight models with vLLM on the bank's own GPUs, on-premise or even air-gapped. Each changes cost, model quality and who operates it.

Deeper answer

Clarify what 'leave the network' means: their cloud account may count as inside. Regulators such as the RBI have outsourcing and data localisation expectations, so involve the bank's risk team early.

Air-gapped deployments need offline model updates, internal monitoring and a support model, which take real planning. Benchmark the open-weight model on the bank's tasks before promising parity with frontier models.

What a strong answer covers

Answer it out loud in the mock interview about 2 min

Follow-ups to expect

Common mistakes

Learn it

Deployment models

Practice Deployment and LLMOps questions

More on this topic

Today's AI turns are used

Lessons, roadmaps, videos, practice cards and the code playground stay free with your account, with no limit.