AI article

Perplexity held flat after INT4. Task accuracy dropped 7 points.

TL;DR: We quantized a fine-tuned 14B agent model to INT4 with GPTQ. Perplexity moved 0.04. We almost...

Dev.to | Jun 19, 2026 | Marcus Chen

Read the original article