What are TTFT, TPOT, and throughput, and how do they trade against each other?
Interview insights are lockedSee how often this is asked and which companies asked it with Buncho Pro.Define the core serving metrics, show how batching, prefill and chunking trade them, and how to set SLOs and measure goodput.