Tech article
How many GPUs is 1M/B/T tokens?
No preview is available. Read the original article for the full story.
Hacker News | Oct 6, 2026 | kmavm
Automated excerpt
» GPU count367H100 GPUs / base211Low853High468x H100 nodes1 trillion tokens in one month (30 days) on Llama 3. 3 70B needs approximately 367 H100 GPUs. Weight size assumes 8-bit. inferencex »DeepSeek R1 / V3671B / 37B671 GBH100: 23, 75, 26612, 16, 21Measured on H100 and B200. H100 ratio is estimated. inferencex 5. 3 »inferencex 5 fp4 »size »DeepSeek V4 Pro1600B / 49B865 GBB200: 468, 1,000, 2,8006, 14, 21Measured on B200 only.
Selected automatically from source text; not independently written or fact-checked. Read the original for full context.