What is cross-entropy loss, and why is it used to train language models?
Interview insights are lockedSee how often this is asked and which companies asked it with Buncho Pro.Define cross-entropy loss for next-token prediction, show its gradient with respect to the logits, and connect it to perplexity.