Computing · 2013
High Bandwidth Memory
Stacked DRAM right beside the processor.
SK Hynix produced the first HBM, stacking DRAM dies connected by through-silicon vias. HBM feeds GPUs and AI accelerators with terabytes per second of bandwidth.
What it built on 1
What it led to 5
Related measurements
The dashed line marks when it first worked.
ML hardware FLOP/s per dollar Source: Epoch AI, ML hardware (CC BY 4.0)
Training compute of notable AI models Source: Epoch AI, Notable AI Models (CC BY 4.0)