Computing · 2015
Tensor Processing Unit
Google's chip built only for neural networks.
Google deployed its first TPU in data centers in 2015, reporting 15-30 times the performance of contemporary CPUs and GPUs on inference. It started the wave of custom AI accelerators.
What it built on 2
What it led to 7
Related measurements
The dashed line marks when it first worked.
ML hardware FLOP/s per dollar Source: Epoch AI, ML hardware (CC BY 4.0)
Training compute of notable AI models Source: Epoch AI, Notable AI Models (CC BY 4.0)