Implement scaled dot-product attention with a causal mask from scratch
Interview insights are lockedSee how often this is asked and which companies asked it with Buncho Pro.Implement attention for a sequence of length T with a causal mask in NumPy, and verify that a token never depends on later tokens.