AI article

The Working Set That Never Saturated

Community description: A count table is random access, so in principle only the pages a document touches need be resident. Across eight real files, seven were still pulling in new pages after 2,700 completions. Then I measured the latency constant the verdict rested on and found it optimistic by 1.8x.

Dev.to | Sep 15, 2026 | Seth Wheeler

Automated excerpt

A bounded cache confirms it from the other direction: the hit rate plateaus at 0. 744 even with 16 MB resident, against 0. 656 at 4 MB and 0. 473 at 1 MB. So "a 143 MB table for 2 MB resident" is not on offer. About 15 page reads per position, with 26% missing at 16 MB resident, is roughly 4 faults per position.

Selected automatically from source text; not independently written or fact-checked. Read the original for full context.

Read the original article

More AI news