Transformers now runs llama.cpp quants

Automated excerpt

GGUF models have been downloaded millions of times. The comparison below focuses on three GGUF checkpoints: a small dense model, a larger dense model, and a mixture-of-experts model. That brings ggml's work into the PyTorch model without replacing the model with a separate inference runtime.

Selected automatically from source text; not independently written or fact-checked. Read the original for full context.