Attention Is All You Need

The Transformer removed the sequential pass used by recurrent networks and related input elements through attention. That made training far more parallel and created a common architecture later transferred from language to code, images, audio and video. The paper became the central fork in modern AI history: nearly every later large language and multimodal model descends from it.