bitdepth.co
HomePillarsTopicsLong-readsAbout
Search⌘KSubscribe
LIVEMon · Aug 3 · 2026, 03:39 UTC
HBM3E demand +47% q/qNVDA inventory lead time −9dSK Hynix HBM4 risk prod 2026Q3TSMC CoWoS capex +$3.8B
↳ The AI memory bottleneck/Background/Long-read · §02
Sub-article 2 of 9 · Published Apr 11 · 6 min read

HBM, explained without metaphors. Stacks, TSVs, and why it's so hard to make.

High-Bandwidth Memory isn't "fast DRAM." It's a wholly different manufacturing problem. We go through the stack, the through-silicon vias, and the packaging step that ties it all to the GPU.

PublishedApr 11, 2026
Length1,600 words · 6 min
Part of pillar
The AI memory bottleneck

Continuously-updated topic hub. Edition 14, updated 2h ago. 9 sub-articles.

Open the full pillar →
Reading
6 min · 1,600 wd
Tagged
BackgroundAISilicon
Related — within this pillar
Supply chain
Samsung's HBM3E qualification, finally. The full timeline and what it means for NVIDIA's 2026 allocation strategy.
May 12
Supply chain
Why every AI training run is now a packaging negotiation.
May 09
Solutions
Cerebras WSE-4 is generally available. We ran the benchmarks. The numbers are real.
May 08
Supply chain
Why Samsung's HBM gap is closing.
May 05
↳ Part of pillar

This is one entry in The AI memory bottleneck.

Thirty more sub-articles, six tracked solution paths, a weekly-updated timeline, and a live aggregated feed — all on the pillar page.

Open the pillar →
More from this pillar

More in The AI memory bottleneck

↳ Supply chain · 9 min

Samsung's HBM3E qualification, finally. The full timeline and what it means for NVIDIA's 2026 allocation strategy.

May 12 · 2,400 words
↳ Supply chain · 14 min

Why every AI training run is now a packaging negotiation.

May 09 · 4,100 words
↳ Solutions · 11 min

Cerebras WSE-4 is generally available. We ran the benchmarks. The numbers are real.

May 08 · 3,200 words
bitdepth.co

Independent technology journalism, organized by what matters — not by what's new. Pillars are our long-running, continuously-updated topic hubs.

Pillars
  • The AI memory bottleneck
  • The advanced packaging race
  • Export controls & the new silicon geopolitics
  • The power wall
  • See all 6 →
Read
  • Homepage
  • Topics
  • Long-reads
  • Search
  • Archive
About
  • Our method
  • Editor
  • Newsletter
  • Sources policy
  • Contact
© 2026 bitdepth.co · Independent · Reader-supportedMade for builders · v3.0 "Pillar"

We use cookies

We use cookies to ensure you get the best experience on our website. For more information on how we use cookies, please see our cookie policy.