A security team is red-teaming an LLM product before release. They generate 10,000 adversarial test cases using an automated red-teaming tool. What does automated red-teaming NOT replace?
- A.Unit tests for the application code that handles the LLM integration
- B.Automated red-teaming replaces all manual testing; 10,000 test cases is comprehensive coverage
- C.Human creative red-teaming that can discover novel attack patterns, culturally specific failure modes, and context-dependent harm scenarios that automated tools trained on known jailbreak patterns may not generate - automated tools excel at coverage breadth on known failure modes but lack the adversarial creativity and contextual judgment of human red-teamers
- D.Automated red-teaming replaces security code reviews of the LLM integration codebase
Why C is correct