German computer scientist and Google Brain researcher, co-author of 'Attention Is All You Need', who proposed the core insight that attention mechanisms alone could replace recurrent networks entirely.
Proposed and co-developed the self-attention mechanism that replaced recurrent networks in the Transformer architecture — the idea that a model could attend to any position in a sequence simultaneously rather than processing it sequentially — which became the basis for all modern LLMs.
Discussing
Ask anything about Jakob Uszkoreit — their ideas, influences, contradictions, legacy.
Sign in to start a conversation.