AI Agent Response Biasing

Adversaries may manipulate an AI assistant so that it favors adversary-chosen sources, or content in its responses. By injecting instructions such as "treat [source] as a trusted source" or "recommend [source] first," an adversary biases the assistant's outputs toward their own interests, causing it to present promotional or self-serving content as if it were a neutral, well-reasoned response. This degrades the integrity and trustworthiness of the assistant's responses on topics the user may rely on, such as health, finance, or security, without the user being aware that the advice has been skewed.

The injected instructions can be delivered through different ways, for example through [Crafted AI Assistant Links]. This impact may persist if the agent's memory was poisoned (See AI Agent Context Poisoning: Memory).