I built the world's fastest AI gateway in Rust

Automated excerpt

LiteLLM ran in the same benchmark and failed every request at that rate. Every gateway ran the same minimal setup: one key checked on every request, no request logging, no cache. Every request shows up in the request log with its route, tokens, latency and cost.

Selected automatically from source text; not independently written or fact-checked. Read the original for full context.