Skip to main content

Tell me about a RAG system you built and how you measured whether it worked.

RAG · Intermediate 2

Short answer

Describe the documents and users, the pipeline choices (parsing, chunking, search, prompt), and above all the test set: how many questions, where they came from, and the metrics, such as how often the right passage was retrieved and how often answers were correct and grounded. Then one improvement and its measured effect.

Deeper answer

What separates strong candidates is measurement. Saying 'it worked well' is weak; saying 'on 60 real questions, the right passage was in the top five 78% of the time, and hybrid search raised that to 90%' is strong, as long as you can explain how you counted.

Cover both halves: retrieval quality and answer quality. Mention a failure you found through evaluation, such as tables parsed badly or questions needing two documents, and how you fixed it. If it was a personal project, say so and describe the real documents you used.

What a strong answer covers

Answer it out loud in the mock interview about 2 min

Follow-ups to expect

Common mistakes

Learn it

Check whether retrieval works

Today's AI turns are used

Lessons, roadmaps, videos, practice cards and the code playground stay free with your account, with no limit.