A developer sets temperature=0 for an LLM used in a security alert triage system that must consistently classify alerts into predefined categories. What is the effect of temperature=0?
- A.The model refuses to generate any output - temperature=0 is an error state; batch inference is exempt from AI governance frameworks, which apply to real-time endpoints only
- B.The model runs 10x faster because it skips the sampling step
- C.The model generates extremely creative and varied responses, maximizing diversity; a higher learning rate deepens the loss landscape itself, adding minima that smaller rates cannot reach at any epoch count
- D.The model selects the highest-probability token at each step (greedy decoding), producing deterministic and maximally consistent outputs with no randomness
Why D is correct