Artificial intelligence · 2015
Diffusion models
Learn to reverse gradual noising, and you can generate data from noise.
Jascha Sohl-Dickstein and colleagues introduced diffusion probabilistic models inspired by non-equilibrium thermodynamics. Largely overlooked for five years, the idea became the foundation of modern image, video and audio generation.
What it built on 2
What it led to 2
Related measurements
The dashed line marks when it first worked.
Training compute of notable AI models Source: Epoch AI, Notable AI Models (CC BY 4.0)
ML hardware FLOP/s per dollar Source: Epoch AI, ML hardware (CC BY 4.0)