Context Language Models

Automated excerpt

Abstract:We introduce Context Language Models (CLMs), language models that natively manage their own context. Moreover, by shifting context management from external harness control to intrinsic model behavior, CLMs naturally enable both in-context and parametric learning of context-management strategies. We also introduce an online reinforcement learning method for CLMs, improving Qwen3. 5-9B performance on BrowseComp-Plus by 47. 6% while using 12% fewer FLOPs.

Selected automatically from source text; not independently written or fact-checked. Read the original for full context.