My Q4 model said True where BF16 said False, so I diffed them layer by layer

Automated excerpt

Diff two llama. cpp runs token by token and layer by layer, and move activations between them to test which layers, and which attention or MLP blocks, carry the divergence. Diff two llama. cpp runs token by token and layer by layer, then move activations between them to test which layers' divergence actually reaches the output. what your model says, and the usual answer to "how much, and where? " is one aggregate number. heterodyne runs two configurations of llama. cpp (two arms: a GGUF file plus the residual stream into the other, layer by layer, in llama.

Selected automatically from source text; not independently written or fact-checked. Read the original for full context.