Concept guide · RAG foundations
What is multi-hop RAG?
A slower explanation for when the short interview answer is not enough. Start with the intuition, then connect it to the technical idea and the way an interviewer expects you to reason about it.
ML area
Generative AI → Multi-hop RAG
Interview format
Advanced · Concept
Question
GENAI-056
Start with the idea
In simple terms
Multi-hop RAG answers a question by finding evidence in more than one step. One result supplies an entity or fact that guides the next search, instead of expecting one passage to contain everything.
Make it concrete
To answer “Which policy changed after the vendor merger and what approval is now required?”, the system may first identify the merger policy, then retrieve the updated approval section.
Build the answer
How to reason about it
- 1Identify the intermediate fact needed to make the next search possible.
- 2Persist evidence and confidence for each hop, not only the final answer.
- 3Bound retries and compare against a simpler single-hop baseline.
Go one level deeper
The technical explanation
The system can decompose a question into sub-questions, retrieve an intermediate fact, route the next query, and assemble an evidence chain. Each hop can amplify an error, so keep a maximum depth, preserve the source for every intermediate claim, detect circular searches, and expose the trace for debugging. Use it when single-hop recall is the measured bottleneck.
Say this in the interview
Multi-hop RAG decomposes a question or follows a chain of evidence across multiple documents or entities. The system retrieves one step, extracts a useful intermediate fact, and uses it to guide the next step. It needs limits, traceability, and checks against compounding early retrieval errors.
Keep preparing