Data from AI Services
Description
Adversaries may use their access to a victim organization's AI-enabled services to collect proprietary or otherwise sensitive information. As organizations adopt generative AI in centralized services for accessing an organization's data, such as with chat agents which can access retrieval augmented generation (RAG) databases and other data sources via tools, they become increasingly valuable targets for adversaries.
AI agents may be configured to have access to tools and data sources that are not directly accessible by users. Adversaries may abuse this to collect data that a regular user wouldn't be able to access directly.
- ATLAS ID
- AML.T0085
- Maturity
- DemonstratedShown to work in research or red-team exercises.
- Platforms
- Generative AIAgentic AI
Sub-techniques
Mitigations
- AML.M0024AI Telemetry Logging
Log requests to AI services to detect malicious queries for data.
- AML.M0026Privileged AI Agent Permissions Configuration
Configuring privileged AI agents with proper access controls can limit an adversary's ability to collect data from AI services if the agent is compromised.
- AML.M0027Single-User AI Agent Permissions Configuration
Configuring AI agents with permissions that are inherited from the user can limit an adversary's ability to collect data from AI services if the agent is compromised.
- AML.M0028AI Agent Tools Permissions Configuration
Configuring AI Agent tools with access controls inherited from the user or the AI Agent invoking the tool can limit adversary's access to sensitive data.
- AML.M0032Segmentation of AI Agent Components
Segmentation can prevent adversaries from utilizing tools in an agentic workflow to collect sensitive data from AI services.
Case studies that use it
No ATLAS case study records this technique yet. Browse all case studies.