How do you optimise RAG for latency in production?
Interview insights are lockedSee how often this is asked and which companies asked it with Buncho Pro.A RAG chatbot has a p95 latency of 9 seconds. How do you find the bottlenecks and reduce latency without a large quality loss?