CyberCertPrepAI Security FundamentalsSecure AI Deployment & MLOpsEASYFree question
Scenario
A consumer startup launched an AI creative writing assistant, relying entirely on the foundation model's built-in safety alignment. Their production incident post-mortem is analyzing how a user triggered inappropriate content generation.
A startup ships an LLM-powered feature without any output filtering, claiming "our model is already safe." Two weeks later, a user triggers a safety failure. What is the primary architectural gap?
- A.The model was not fine-tuned on enough safety examples
- B.The model's context window was too small
- C.The system prompt was not written in formal English; model files are inert data to every loader, and arbitrary code execution requires a separate vulnerability in the serving host
- D.Relying solely on the model's built-in safety training without any application-layer defense-in-depth - safety training is a probabilistic control that can be bypassed; production systems require additional guardrails independent of the model
Why D is correct