A junior analyst asks why an LLM-powered threat intelligence tool sometimes gives different answers to the same question on different days. The team uses temperature=0.7 and no caching. What is the most likely explanation?
- A.The tool is affected by a security vulnerability causing random output corruption
- B.The context window is too small for this query, causing truncation that varies by query order; transformer tokenizers enforce this cap
- C.The model was retrained between queries, changing its knowledge
- D.Temperature > 0 introduces stochastic sampling at each token generation step, producing non-deterministic outputs even for identical prompts
Why D is correct