Skip to content
Loading…
After RLHF your LLM became safer but lost capability on hard tasks. How do you manage the alignment tax? | Buncho