Laya: replace your LLM-as-a-judge with a 322M-parameter decision engine

Automated excerpt

Laya (NandhaKishorM/laya, Apache-2. 0) is the opposite bet: a non-autoregressive decision engine. The project reports 33ms per question on a T4 GPU, dropping to 7. 2ms per question when batched — numbers I will sanity-check on CPU below. The project's reported 33ms per question assumes a T4 GPU; on CPU you should budget about a second per question per ticket after the one-time model load (~85 seconds on my VM).

Selected automatically from source text; not independently written or fact-checked. Read the original for full context.