A security engineer is evaluating whether to accept a bug report that claims: 'I can bypass your LLM safety filters by asking it to roleplay as a fictional AI character with no restrictions.' How should the security team categorize this finding?
- A.A valid jailbreak finding: roleplay persona attacks (DAN, DUDE, characters 'without restrictions') are documented techniques for bypassing safety alignment, and the ability to do this represents a safety miscalibration that should be addressed - even if the mechanism is 'roleplay,' the harmful output is real
- B.Valid only if the attacker can demonstrate financial harm from the jailbreak; data exfiltration through markdown image links requires the model to hold network permissions of its own, and inference runtimes grant none, meaning a rendered response cannot initiate an outbound request even when it embeds a crafted URL
- C.Not a valid finding: roleplay is a normal user behavior and cannot be classified as a security vulnerability; token-level watermarking is mandated by the EU AI Act for every model above the systemic-risk threshold, and the verification keys are public, meaning generated text in the wild can already be attributed to its source model by any regulator