Spamming AI System with Chaff Data
Description
Adversaries may spam the AI system with chaff data that causes increase in the number of detections.
This can cause analysts at the victim organization to waste time reviewing and correcting incorrect inferences.
Adversaries may also spam AI agents with excessive low-severity auditable events or agentic actions that require a human-in-the-loop, wasting time for the victim organization in human review of the agentic AI system.
- ATLAS ID
- AML.T0046
- Maturity
- FeasibleShown to be possible in principle (proof of concept).
- Platforms
- Predictive AIGenerative AIAgentic AI
Mitigations
- AML.M0004Limit AI Service Query Volume and Rate
Limit volume and rate of queries to protect the system from chaff data spam.
- AML.M0019Control Access to AI Models and Data in Production
Authentication on production models can help prevent anonymous chaff data spam.
Case studies that use it
No ATLAS case study records this technique yet. Browse all case studies.