Manipulate AI Model
Description
Adversaries may manipulate an AI model artifact or its bundled components to change AI system behavior, introduce malicious code, or establish persistent malicious functionality. This may include modifying model weights, model architecture, or prompt-construction logic.
Manipulated artifacts may retain expected behavior under ordinary conditions while activating malicious behavior only for selected inputs, contexts, or deployment conditions.
- ATLAS ID
- AML.T0018
- Maturity
- RealizedUsed by real adversaries against AI systems in the wild.
- Platforms
- Predictive AIGenerative AIAgentic AI
Sub-techniques
Mitigations
- AML.M0005Control Access to AI Models and Data at Rest
Access controls can prevent tampering with AI artifacts and prevent unauthorized modification.
- AML.M0008Validate AI Model
Validating an AI model against a wide range of adversarial inputs can help increase confidence that the model has not been manipulated.
- AML.M0013Code Signing
Code signing provides a guarantee that the model has not been manipulated after signing took place.
- AML.M0035AI Red Team
Attempt controlled modification or substitution of models, weights, adapters, and related configuration. Remediate weaknesses in authorization, artifact integrity, deployment approval, monitoring, and recovery.
Case studies that use it
No ATLAS case study records this technique yet. Browse all case studies.