Walk through one forward pass of a decoder-only Transformer
Interview insights are lockedSee how often this is asked and which companies asked it with Buncho Pro.Walk me through what happens, step by step, in one forward pass of a decoder-only Transformer.
Use tensor shapes for batch size , sequence length , model width , heads and vocabulary size . Then explain how generation differs from a training forward pass.