Jailbreaking is crafting inputs (role-play, hypothetical framing, encoding tricks, multi-turn escalation) that get the model to ignore its safety rules.
Mitigate with model-level alignment, input and output moderation, system-prompt hardening, rate limits and abuse detection, and continuous red-teaming with a growing library of attacks.
Assume some attempts will succeed and design downstream controls so a successful jailbreak cannot cause serious harm.
Loading…