Manual Modification
Sub-technique of AML.T0043 Craft Adversarial Data
Description
Adversaries may manually modify the input data to craft adversarial data.
They may use their knowledge of the target model to modify parts of the data they suspect helps the model in performing its task.
The adversary may use trial and error until they are able to verify they have a working adversarial input.
- ATLAS ID
- AML.T0043.003
- Maturity
- RealizedUsed by real adversaries against AI systems in the wild.
- Platforms
- Predictive AI
Mitigations
- AML.M0003Predictive AI Model Hardening
Hardened models are more robust to adversarial inputs.
- AML.M0004Limit AI Service Query Volume and Rate
Limit volume of model queries to prevent or slow an adversary's ability to refine manually crafted adversarial inputs.
- AML.M0006Predictive AI Ensembles
Using an ensemble of models increases the difficulty of crafting effective adversarial data and improves overall robustness.
- AML.M0010Predictive AI Input Restoration
Input restoration can help remediate adversarial inputs.
- AML.M0015Predictive AI Adversarial Input Detection
Incorporate adversarial input detection to block malicious inputs at inference time.