What 586 Real Traces Taught Us About LLM Agent Determinism

Automated excerpt

How temperature selectively degrades agent reasoning — and what that means for observability. It selectively degrades complex reasoning while simple lookups survive. Q1 (complex): sd 1.7 — already breaking Q4 (complex): sd 2.0 — breaking Q3, Q7, Q9 (simple): sd 0.0 — perfect Q7 (simple): sd 1.6 — finally breaks Q8 (simple): sd 0.0 — still perfect The pattern: Multi-file synthesis questions degrade at 0.3.

Selected automatically from source text; not independently written or fact-checked. Read the original for full context.