Starcast
Join the waitlist
Transformers: The Discovery That Sparked the AI Revolution
Coming soon to iPhone. Already have it? “Listen in Starcast” takes you straight there.
On this episode
About this episode
Nearly every modern AI model, from ChatGPT and Claude to Gemini and Grok, is built on the same foundation: the Transformer.In this video, YC's Ankit Gupta traces how AI learned to understand language — from early RNNs and LSTMs to attention mechanisms and the breakthrough 2017 paper Attention Is All You Need — the discovery that unlocked the modern AI era.