What are prefill and decode in LLM inference, and why is prefill compute-bound while decode is memory-bandwidth-bound?
Interview insights are lockedSee how often this is asked and which companies asked it with Buncho Pro.Describe the two phases of autoregressive inference, their bottlenecks with a worked example, and the optimisations each implies.