AI article
Run GLM-5.3-Flash (321B) locally with Project Maya and EXL3 on one RTX 5090
Community description: GLM-5.3-Flash is a 321B mixture-of-experts model, and its 3.05 bpw EXL3 quant is 125 GB, too big to...
Dev.to | Oct 16, 2026 | Seppe Gadeyne
Automated excerpt
Maya ships its own GGUF quants (Maya-S 96. 5 GB, Maya-M 116 GB, Maya-L 156 GB). RAM: 128 GB DDR5 as 4x32 GB at 5,600 MT/s. Maya pins RAM until about 4-5 GB is free and holds 29-30 GB of VRAM.
Selected automatically from source text; not independently written or fact-checked. Read the original for full context.