Paged attention, two years later.

vLLM's paged attention paper changed inference economics overnight. Two years of production data later, here's what actually happened to the KV-cache problem — and what's still unsolved.