Stone to Silicon

Artificial intelligence · 2024

Test-time compute scaling

Accuracy rises smoothly with how long the model is allowed to think.

o1's results showed performance scaling with inference compute as well as training compute. Longer reasoning, parallel sampling and search turned extra compute at answer time into reliable gains, reshaping hardware demand toward inference.

See it in the living treeWikipedia

Arcs above join it to what it stood on, arcs below to what it led to. The bar places this stretch on the tree's whole timeline.

What it built on 2

What it led to 3

Related measurements

The dashed line marks when it first worked.

Training compute of notable AI models Source: Epoch AI, Notable AI Models (CC BY 4.0)