What is Constitutional AI, and how does it differ from RLHF?
Interview insights are lockedSee how often this is asked and which companies asked it with Buncho Pro.Explain Anthropic's Constitutional AI method, its two stages, and the trade-offs compared with human-feedback RLHF.
Hints
Related questions
- Users are extracting your chatbot's system prompt, including proprietary business logic. How do you prevent it, and how do you defend an agent against injection that reveals it?Hard
- What is RLHF (Reinforcement Learning from Human Feedback), and how does it align LLMs? What was the original Deep RL from Human Preferences paper?