Extract LLM System Prompt
Description
Adversaries may attempt to extract a large language model's (LLM) system prompt. Adversaries achieve this via prompt injection that induces the model to reveal its system prompt, or they may extract it from a configuration file.
System prompts can be a portion of an AI provider's competitive advantage and are thus valuable intellectual property that may be targeted by adversaries.
- ATLAS ID
- AML.T0056
- Maturity
- FeasibleShown to be possible in principle (proof of concept).
- Platforms
- Generative AIAgentic AI
Mitigations
- AML.M0020Generative AI Guardrails
Guardrails can prevent harmful inputs that can lead to meta prompt extraction.
- AML.M0021Generative AI Guidelines
Model guidelines can instruct the model to refuse a response to unsafe inputs.
- AML.M0022Generative AI Model Alignment
Model alignment can improve the parametric safety of a model by guiding it away from unsafe prompts and responses.
- AML.M0035AI Red Team
Probe model and application interfaces for disclosure of system instructions, policies, tool definitions, or hidden context. Remove embedded secrets and improve configuration isolation and output controls.
Case studies that use it
No ATLAS case study records this technique yet. Browse all case studies.