Discover AI Model Family
Description
Adversaries may discover the general family of a model.
General information about the model may be revealed in documentation, or the adversary may use carefully constructed examples and analyze the model's responses to categorize it.
Knowledge of the model family can help the adversary identify means of attacking the model and help tailor the attack.
- ATLAS ID
- AML.T0014
- Maturity
- FeasibleShown to be possible in principle (proof of concept).
- Platforms
- Predictive AIGenerative AIAgentic AI
Mitigations
- AML.M0002Predictive AI Output Obfuscation
Suggested approaches:
- Restrict the number of results shown
- Limit specificity of output class ontology
- Use randomized smoothing techniques
- Reduce the precision of numerical outputs
- AML.M0004Limit AI Service Query Volume and Rate
Limit inference queries to reduce an adversary's ability to infer the family of AI model.
- AML.M0006Predictive AI Ensembles
Use multiple different models to fool adversaries of which type of model is used and how the model used.
Case studies that use it
No ATLAS case study records this technique yet. Browse all case studies.