Janas: Run LLMs larger than RAM by streaming experts from SSD

Automated excerpt

37 tok/s from Qwen3-Next-80B (a 48 GB model) on a laptop with 32 GB of memory, 24 without drafts, where llama. cpp manages 2. 8; reading a prompt, 62 tok/s against 16. It does not touch the model files it reads. What Janas-LLM runs today, model by model and feature by feature: docs/features. md.

Selected automatically from source text; not independently written or fact-checked. Read the original for full context.