Overview
Jakob Uszkoreit is a researcher and entrepreneur. He is one of the eight authors of “Attention Is All You Need”, a paper submitted to arXiv on 12 June 2017.[1] He is also the founder of Inceptive, a company described as using artificial intelligence to design novel biological molecules.[4]
Main contributions
Uszkoreit is one of the eight authors of “Attention Is All You Need”.[1] On 31 August 2017, Google’s Research Blog published a post titled “Transformer: A Novel Neural Network Architecture for Language Understanding”; the post is credited to Jakob Uszkoreit, Software Engineer, Natural Language Understanding.[2] In 2018, he co-authored “Universal Transformers” with Mostafa Dehghani, Stephan Gouws, Oriol Vinyals and Łukasz Kaiser; the paper was submitted to arXiv on 10 July 2018.[3]
Career
The 31 August 2017 Research Blog byline identifies Uszkoreit as a Software Engineer working in Natural Language Understanding at Google.[2] Maginative describes him as a former Google AI researcher.[4] According to Maginative, he founded Inceptive.[4] The company raised $100 million in a funding round led by NVIDIA’s NVentures and Andreessen Horowitz.[4]
Why it matters
Uszkoreit’s published work places him in the line of research around Transformer models: he is a co-author of both “Attention Is All You Need” and “Universal Transformers”.[1][3] The Google Research Blog post he wrote presents Transformer as a novel neural network architecture for language understanding.[2] At Inceptive, the stated aim is to use artificial intelligence to design novel biological molecules for vaccines, therapeutics and other treatments.[4] That work connects language understanding with biological design, as described in coverage of the company.[4]
TechniquesDeep learningTransformers & attention
ApplicationsBiomedicine
Career timeline
1-
2017
-
Attention Is All You Need
Contributed to
A 2017 paper that introduced the Transformer, a neural network built entirely on attention with no recurrence. It set new machine translation results and became the architecture behind almost every large language model since.
-
Attention Is All You Need
Contributed to
Contributed to1
Notes and sources
- Attention Is All You Needhttps://arxiv.org/abs/1706.03762
- Transformer: A Novel Neural Network Architecture for Language Understandinghttps://research.google/blog/transformer-a-novel-neural-network-architecture-for-language-understanding/
- Universal Transformershttps://arxiv.org/abs/1807.03819
- Inceptive Raises $100 Million to Design New Vaccines and Therapies with AIhttps://www.maginative.com/article/inceptive-raises-100-million-to-design-new-vaccines-and-therapies-with-ai
Cite this page: Jakob Uszkoreit. TellWorld, https://www.tellworld.net/people/jakob-uszkoreit. Updated 2026-11-08