A client tells you their AI assistant invented a policy clause and a customer acted on it. What do you do?
Client delivery · Pro 1
Short answer
First contain it: tell the client, correct the customer's information, and block similar answers for now. Then read the trace to find the cause: wrong documents, poor retrieval, or the model answering beyond its sources. Fix that, add the case and similar ones to the test set, and add an automatic check of claims against sources.
Deeper answer
I would look at the full trace: the question, the retrieved passages and the answer. If the clause was not in any passage, the model answered beyond its sources, so I would tighten the instruction to answer only from sources and say when they are silent, and add an entailment or judge check on every claim.
If retrieval missed the real clause, I would fix chunking, filters or the index. I would search logs for other answers on the same topic, report findings and fixes to the client in writing, and agree a review step for policy answers until the checks prove themselves.
What a strong answer covers
- Contains the harm and informs the client
- Reads the trace to find the cause
- Adds an automatic claim or source check
- Adds cases to the test set and reviews similar answers
Answer it out loud in the mock interview about 1.5 min
Follow-ups to expect
- How would you find other affected customers?
- What would you change so this is caught automatically next time?
Common mistakes
- Only changing the prompt and moving on
- Not checking whether other users got the same wrong answer
Learn it
Catching hallucinations: why models make things up and how to detect it
- How would you connect an AI assistant to a client's SharePoint, Salesforce and Jira?
- How do you update a client's executives on an AI project?
- Midway through a project, the client keeps adding requests. How do you handle it?
- How do you hand over an AI system to the client's team?
- How do you move an AI solution from proof of concept to production?
- You start with a new enterprise client. How do you run discovery?
- A client says 'automate our sales process'. What do you do first?
- The client's staff are worried your automation will replace them. How do you handle it?
- What goes into a scope of work for an AI project?