Computing · February 2026
HBM4 memory
Stacked memory reaches 3.3 TB/s per stack.
Samsung shipped the first commercial HBM4 at 11.7 Gbps per pin and up to 3.3 TB/s per stack, 2.7 times HBM3E, on a 4 nm logic base die. Memory bandwidth, not arithmetic, sets the pace of large-model inference.
What it built on 1
Related measurements
The dashed line marks when it first worked.
ML hardware FLOP/s per dollar Source: Epoch AI, ML hardware (CC BY 4.0)
Training compute of notable AI models Source: Epoch AI, Notable AI Models (CC BY 4.0)