PANTHEON
ExploreBuild My Library
© 2026 Pantheon — an atlas of the ideas that shaped how we think.
person2010s–present

Jakob Uszkoreit

Disciplines:
machine learning
artificial intelligence/natural language processing
artificial intelligence

Summary

German computer scientist and Google Brain researcher, co-author of 'Attention Is All You Need', who proposed the core insight that attention mechanisms alone could replace recurrent networks entirely.

Core Contribution

Proposed and co-developed the self-attention mechanism that replaced recurrent networks in the Transformer architecture — the idea that a model could attend to any position in a sequence simultaneously rather than processing it sequentially — which became the basis for all modern LLMs.

Notable Works & Achievements

Attention Is All You Need

Historical Influences

Noam Shazeer Jeff Dean

Intellectual Lineage

Google Brain Research CultureNLP Research Tradition

Contemporaries & Peers

Noam Shazeer Ilya Sutskever Ashish Vaswani

Minds Influenced

Sam Altman Entire LLM field

Intellectual Posterity

Transformer architecture

Discussing

Jakob Uszkoreit

Ask anything about Jakob Uszkoreit — their ideas, influences, contradictions, legacy.

Sign in to start a conversation.