Computing · 2024
Nvidia Blackwell
Two dies joined as one GPU with 208 billion transistors.
Nvidia's Blackwell, announced in March 2024, joins two reticle-sized dies through a 10 TB/s link. GB200 NVL72 racks link 72 GPUs as a single system for AI training and inference.
What it built on 3
What it led to 3
Related measurements
The dashed line marks when it first worked.
ML hardware FLOP/s per dollar Source: Epoch AI, ML hardware (CC BY 4.0)
Training compute of notable AI models Source: Epoch AI, Notable AI Models (CC BY 4.0)
Transistors per microprocessor Latest: 58.2B transistors (2021) Source: Our World in Data