Artificial intelligence · 2020

Vision transformer

Split an image into 16x16 patches, treat them as words, and a transformer sees.

Alexey Dosovitskiy and colleagues at Google showed that pure transformers match or beat convolutional networks on image classification when pretrained on enough data. ViTs unified vision and language architectures and underpin multimodal models.

See it in the living treeWikipedia