Artificial intelligence · 2023

Llama

Meta's efficient models leak, and open-weights AI takes off.

Meta released LLaMA in February 2023 in sizes up to 65B parameters; its 13B model beat GPT-3 on most benchmarks. The weights leaked within a week, igniting a wave of fine-tunes such as Alpaca and Vicuna and a whole open model ecosystem.

See it in the living tree Wikipedia

Arcs above join it to what it stood on, arcs below to what it led to. The bar places this stretch on the tree's whole timeline.

What it built on 2

Chinchilla scaling 2022
GPT-3 2020

What it led to 3

Llama 2 2023
llama.cpp 2023
Mistral 7B 2023

Related measurements

The dashed line marks when it first worked.

Best AI score on GPQA Diamond Latest: 95.8 % correct (2026) Source: Epoch AI, Capabilities & benchmarking (benchmark_data.zip, gpqa_diamond.csv); Anthropic: Claude 3 public launch (March 4, 2024)

Training compute of notable AI models Source: Epoch AI, Notable AI Models (CC BY 4.0)