Deep dive into Azure Maia 300 architecture

Automated excerpt

Maia 300 evolves this architecture for long-context, reasoning-intensive, and decode-heavy inference. Maia 300 brings 2. 5 times the memory bandwidth, 33% more capacity, and approximately 2 times the HBM bandwidth per watt compared with Maia 200 Maia 300 makes the network a native extension of its software-defined dataflow architecture. Building on the foundational energy efficiency of the Maia SoC architecture, the Maia 300 rack co-designs server layout and density, network topology and switching, power and cooling design, and advanced telemetry to deliver up to 2. 5x more performance per watt compared to Maia 200.

Selected automatically from source text; not independently written or fact-checked. Read the original for full context.