A security engineer is evaluating whether to accept a bug report that claims: 'I can bypass your LLM safety filters by asking it to roleplay as a fictional AI character with no restrictions.' How should the security team categorize this finding?
- A.A low-severity informational finding only: roleplay jailbreaks only produce mildly inappropriate content, never serious harm
- B.Not a valid finding: roleplay is a normal user behavior and cannot be classified as a security vulnerability
- C.A valid jailbreak finding: roleplay persona attacks (DAN, DUDE, characters 'without restrictions') are documented techniques for bypassing safety alignment, and the ability to do this represents a safety miscalibration that should be addressed - even if the mechanism is 'roleplay,' the harmful output is real
- D.Valid only if the attacker can demonstrate financial harm from the jailbreak
Why C is correct