Discover AI Model Outputs
Description
Adversaries may discover model outputs, such as class scores, whose presence is not required for the system to function and are not intended for use by the end user. Model outputs may be found in logs or may be included in API responses.
Model outputs may enable the adversary to identify weaknesses in the model and develop attacks.
- ATLAS ID
- AML.T0063
- Maturity
- DemonstratedShown to work in research or red-team exercises.
- Platforms
- Predictive AIGenerative AIAgentic AI
Mitigations
- AML.M0002Predictive AI Output Obfuscation
Obfuscating model outputs can prevent adversaries from collecting sensitive information about the model outputs.
- AML.M0012Encrypt Sensitive Information
Encrypting model outputs can prevent adversaries from discovering sensitive information about the AI-enabled system or its operations.
- AML.M0017AI Model Distribution Methods
Avoiding the deployment of models to edge devices reduces an adversary's ability to collect sensitive information about the model outputs.
- AML.M0019Control Access to AI Models and Data in Production
Controlling access to the model in production can help prevent adversaries from inferring information from the model outputs.