AI article
Serving Sage-A1.5 on an RTX 4090: one broken flag, one queue, and a self-check mode to measure
Community description: Sage-A1.5 ran at about 136 tokens/s on one 24 GB card. The model card's llama.cpp flag fails, and Verification Mode doubled tokens on easy questions.
Dev.to | Nov 8, 2026 | InferenceKey
Automated excerpt
Run Sage-A1.5 as a research agent on your own card and the surprises are not in the model. The llama.cpp command in the model card will not start. The model reasons through hidden tokens before it answers, and those count against max_tokens.
Selected automatically from source text; not independently written or fact-checked. Read the original for full context.