Season 2 · Episode 1282
The Geometry of Thought: The Mathematics Powering AI
Peeking under the hood of AI to discover the beautiful linear algebra and calculus that make machine reasoning possible.
My Weird Prompts · Daniel Rosehill
March 16, 202621m 56s
Audio is streamed directly from the publisher (dts.podtrac.com) as published in their RSS feed. Play Podcasts does not host this file. Rights-holders can request removal through the copyright & takedown page.
Show Notes
Behind every poetic response or lines of code generated by an AI lies a staggering amount of floating-point numbers and matrix multiplications. This episode explores the mathematical substrate of artificial intelligence, moving past the chat interface to examine the probability, calculus, and high-dimensional geometry that allow these models to function. We dive into the "Neural Cathedral" of embedding spaces and the optimization algorithms that allow machines to learn from their mistakes through pure mathematics.