Season 2 · Episode 1547
Why AI Stopped Reading and Started Seeing Everything
From sequential bottlenecks to parallel powerhouses, discover how the Transformer architecture revolutionized how machines process the world.
My Weird Prompts · Daniel Rosehill
March 25, 202622m 20s
Audio is streamed directly from the publisher (dts.podtrac.com) as published in their RSS feed. Play Podcasts does not host this file. Rights-holders can request removal through the copyright & takedown page.
Show Notes
Before 2017, artificial intelligence struggled with a "memory" problem, processing information one slow step at a time through a narrow straw. This episode explores the monumental shift triggered by the "Attention Is All You Need" paper, which introduced the Transformer architecture and retired an entire generation of models overnight. We break down the mechanics of self-attention, the transition from Recurrent Neural Networks to parallel processing, and why this specific technology became the universal engine for everything from ChatGPT to protein folding. Whether you are a casual listener or a technical expert, this is a deep dive into the foundational technology that defines the modern era of AI.