Tech article
Accelerated Out of Core Shuffling
No preview is available. Read the original article for the full story.
Hacker News | Sep 25, 2026 | quasiben
Automated excerpt
But it will suffice for now - alloc-device: 17. 50 GiB | 1. 73 ms | 9. 90 TiB/s | avg-stream-delay 213. 98 us - event-loop-total: 3. 44 ms | avg 2. 29 us - metadata-payload-exchange-complete-data-transfers: 518. 71 us | avg 345. 80 ns - metadata-payload-exchange-progress: 2. 35 ms | avg 1. 57 us - metadata-payload-exchange-receive-metadata: 558. 98 us | avg 372. 65 ns - metadata-payload-exchange-setup-data-receives: 617. 31 us | avg 411. 54 ns - shuffle-payload-recv: 17. 50 GiB | avg 319. 95 MiB - shuffle-payload-send: 17. 50 GiB | avg 320.
Selected automatically from source text; not independently written or fact-checked. Read the original for full context.