Stone to Silicon

Computing · 2007

CUDA

GPUs become general-purpose parallel computers.

Nvidia's CUDA platform let programmers write C code for GPUs. It made GPUs the workhorses of scientific computing and later of deep learning.

See it in the living treeWikipedia

Arcs above join it to what it stood on, arcs below to what it led to. The bar places this stretch on the tree's whole timeline.

What it built on 2

What it led to 3

Related measurements

The dashed line marks when it first worked.

ML hardware FLOP/s per dollar Source: Epoch AI, ML hardware (CC BY 4.0)

Training compute of notable AI models Source: Epoch AI, Notable AI Models (CC BY 4.0)