PANTHEON
ExploreBuild My Library
© 2026 Pantheon — an atlas of the ideas that shaped how we think.
Discipline Focus

machine learning architecture

1 thinkers, books, and ideas connected to this field.

Essay

Attention Is All You Need

The 2017 paper by Vaswani, Shazeer, Uszkoreit, and five other Google Brain researchers introducing the Transformer architecture — replacing recurrent networks with self-attention — which became the foundation for GPT, BERT, and all subsequent large language models.

natural language processingartificial intelligencemachine learning architecture
View Profile