Implement a KV cache and single-step decode for causal multi-head attention
Interview insights are lockedSee how often this is asked and which companies asked it with Buncho Pro.Implement incremental decoding: a prefill step for the prompt, then a decode step that processes one new token using cached keys and values. Prove it matches full recomputation.