Explain the difference between pre-training, supervised fine-tuning (SFT), and preference optimization (RLHF/DPO). How does SFT differ from alignment training?
Interview insights are lockedSee how often this is asked and which companies asked it with Buncho Pro.Lay out the stages of building a chat model, with data, objective and purpose of each stage.