Smallops benchmark report · MD Can Small Local Models Be Agentic? A 6-Round Benchmark of 4 Ollama Models

Automated excerpt

Most small models (1–1. 5B parameters) don't. One model invented an entire fictional folder structure that was never real, then repeated the identical "file not found" error three times in a row without ever checking what files actually existed. Given an ambiguous task, one model got stuck repeatedly re-running near-identical shell commands with trivial variations, never converging on a final decision and never taking the actual action the task required.

Selected automatically from source text; not independently written or fact-checked. Read the original for full context.