What ChatGPT is actually doing when it answers you

Automated excerpt

It does one thing, over and over: guess the next token, append it, guess again. Meaning is geometry — words become vectors; "king" sits near "queen". Temperature is why the same prompt gives different answers. The context window is why it "forgets" — the oldest text literally falls off. Hallucination is the model doing its job (plausible text) where plausible ≠ true.

Selected automatically from source text; not independently written or fact-checked. Read the original for full context.