Skip to main content

How do you keep a RAG index up to date as documents change?

RAG · Pro 1

Short answer

Use incremental indexing instead of rebuilding: detect changes with timestamps, content hashes or change data capture from the source, re-parse and re-embed only changed documents, delete chunks of removed ones, and keep stable document IDs so updates replace old chunks. Track freshness and run the pipeline on a schedule or from change events.

Deeper answer

Deletions are the part teams forget: a removed policy that still sits in the index will be retrieved. Store a document ID and version on every chunk so you can remove all of a document's chunks at once.

Changing the embedding model or chunking means a full re-index, so version the index and switch over only after evaluating the new one.

What a strong answer covers

Answer it out loud in the mock interview about 1.5 min

Follow-ups to expect

Common mistakes

Learn it

Data pipelines for AI

Today's AI turns are used

Lessons, roadmaps, videos, practice cards and the code playground stay free with your account, with no limit.