Skip to main content

Your HR assistant keeps quoting last year's leave policy. How do you fix it?

RAG · Intermediate 2

Short answer

The old document is still in the index and is being retrieved. I would find it, then fix the pipeline: remove or archive replaced documents, store an effective date and version as metadata, filter retrieval to the current version by default, and re-index on every change. Then add test questions about the new policy so it cannot slip back.

Deeper answer

Stale answers are usually an ingestion problem, not a model problem. If old and new versions sit side by side, the retriever may prefer the old one simply because its wording matches the question better.

The durable fix is lifecycle management: each document has an owner, a version, an effective date and a status; the index updates when the source changes; and retrieval filters out superseded versions. Showing the source and its date in the answer lets employees spot problems, and evaluation questions on recent changes catch regressions.

What a strong answer covers

Answer it out loud in the mock interview about 1.5 min

Follow-ups to expect

Common mistakes

Learn it

Metadata that helps retrieval

Today's AI turns are used

Lessons, roadmaps, videos, practice cards and the code playground stay free with your account, with no limit.