Special Character Sets
Sub-technique of AML.T0069 Discover LLM System Information
Description
Adversaries may discover delimiters and special characters sets used by the large language model. For example, delimiters used in retrieval augmented generation applications to differentiate between context and user prompts. These can later be exploited to confuse or manipulate the large language model into misbehaving.
- ATLAS ID
- AML.T0069.000
- Maturity
- DemonstratedShown to work in research or red-team exercises.
- Platforms
- Generative AIAgentic AI
Mitigations
- AML.M0005Control Access to AI Models and Data at Rest
Restrict access to stored prompt templates and configurations containing internal delimiters.
- AML.M0019Control Access to AI Models and Data in Production
Authenticate and monitor access to production models and prompt configuration.
- AML.M0020Generative AI Guardrails
Filter responses that expose hidden prompt formatting, delimiters, or internal instructions.