Artificial intelligence · 2024

Llama 3

Meta trains on 15 trillion tokens and releases a 405B open frontier model.

Llama 3 arrived in April 2024 and Llama 3.1 405B in July 2024, the first openly available model competitive with GPT-4 class systems. Its weights let others distill and fine-tune near-frontier capability.

See it in the living tree Wikipedia

Arcs above join it to what it stood on, arcs below to what it led to. The bar places this stretch on the tree's whole timeline.

What it built on 2

Llama 2 2023
Nvidia H100 2022

What it led to 2

DeepSeek-V3 2024
Muse Spark 2026

Related measurements

The dashed line marks when it first worked.

Best AI score on GPQA Diamond Latest: 95.8 % correct (2026) Source: Epoch AI, Capabilities & benchmarking (benchmark_data.zip, gpqa_diamond.csv); Anthropic: Claude 3 public launch (March 4, 2024)

Training compute of notable AI models Source: Epoch AI, Notable AI Models (CC BY 4.0)