Diagnose irrelevant retrieval results in a RAG pipeline
Interview insights are lockedSee how often this is asked and which companies asked it with Buncho Pro.Your company's HR assistant answers employee questions from policy documents. Employees complain that it often answers about the wrong policy. For example, an employee in India asked about paternity leave and received details of a US maternity policy.
A colleague has already checked the generation step: the model summarises whatever context it is given, faithfully.
Use the Scenario data (a retrieval trace for one failing query, and the retriever configuration) to work out why retrieval returns irrelevant results, how you would fix it, and how you would prove the fix works.
Scenario data
Logs and configuration from the incident. Use them as evidence in your answer.