Skip to main content

What are hybrid search and reranking, and when do they help?

RAG · Intermediate 2

Short answer

Hybrid search combines vector search, which matches meaning, with keyword search such as BM25, which matches exact words like error codes and names. Reranking takes the top results and re-scores them with a stronger model to put the best first. Together they usually improve retrieval at some extra cost and latency.

Deeper answer

Vector search alone can miss exact identifiers; keyword search alone misses paraphrases. Running both and merging the results, for example with reciprocal rank fusion, covers both cases. A reranker, often a cross-encoder that reads the query and chunk together, is slower per item but more accurate, so it is applied only to the top few dozen candidates.

Published results, such as Anthropic's contextual retrieval write-up, show large drops in retrieval failures from combining these steps. Whether they pay off for you depends on your queries: measure recall before and after, and check the added latency fits your budget.

What a strong answer covers

Answer it out loud in the mock interview about 1.5 min

Follow-ups to expect

Common mistakes

Learn it

Vector search

Today's AI turns are used

Lessons, roadmaps, videos, practice cards and the code playground stay free with your account, with no limit.