Will AI Ever Have Common Sense?
Why are the trickiest queries often easier for ChatGPT to answer than relatively simple questions that hinge on basic common sense? The answer lies somewhere deep in the layers upon layers of neural networks that make up large language models. On this week’s episode of “The Joy of Why,” co-host Steven Strogatz and 2022 MacArthur Fellow Yejin Choi take us into the ever-evolving, months-long training processes that are shaping the future of AI.
The Joy of Why · Steven Strogatz, Janna Levin and Quanta Magazine
Audio is streamed directly from the publisher (dts.podtrac.com) as published in their RSS feed. Play Podcasts does not host this file. Rights-holders can request removal through the copyright & takedown page.
Show Notes
Common sense rules our world. This fundamental, sometimes trivial knowledge is inherent to how humans interpret language. Yet, some of these simple human truths are so obvious that they're rarely put into words. And without the data of common sense to train on, large language models such as ChatGPT have bizarre, often humorous blind spots.
Yejin Choi, professor and the chair of computer science at the University of Washington, calls common sense the “dark matter” of intelligence. In this week’s episode of “The Joy of Why,” Choi talks with co-host Steven Strogatz about decoding the interstitial glue of language and comprehension. Together, they explore the question: Should we program more humanity into the next generation of artificial intelligence?