Artificial intelligence · 2024

Gemini 1.5 long context

A model that reads a million tokens: hours of video or whole codebases at once.

Gemini 1.5 Pro, announced February 2024, used a MoE architecture with a 1 million token context window, later 2 million. It recalled needles in haystacks with over 99% accuracy and made whole-repository and whole-film prompts routine.

See it in the living tree Wikipedia

Arcs above join it to what it stood on, arcs below to what it led to. The bar places this stretch on the tree's whole timeline.

What it built on 2

Gemini 1.0 2023
Mixture of experts 1991

What it led to 1

Gemini 2.5 Pro 2025

Related measurements

The dashed line marks when it first worked.

Best AI score on GPQA Diamond Latest: 95.8 % correct (2026) Source: Epoch AI, Capabilities & benchmarking (benchmark_data.zip, gpqa_diamond.csv); Anthropic: Claude 3 public launch (March 4, 2024)

Training compute of notable AI models Source: Epoch AI, Notable AI Models (CC BY 4.0)