Foresight Institute Radio

What are the best strategies for addressing extreme risks from artificial superintelligence? In this 4-hour conversation, decision theorist Eliezer Yudkowsky and computer scientist Mark Miller discuss their cruxes for disagreement. They examine the future of AI, existential risk, and whether alignment is even possible. Topics include AI risk scenarios, coalition dynamics, secure systems like seL4, hardware exploits like Rowhammer, molecular engineering with AlphaFold, and historical analogies like nuclear arms control. They explore superintelligence governance, multipolar vs singleton futures, and the philosophical challenges of trust, verification, and control in a post-AGI world.Moderated by Christine Peterson, the discussion seeks the least risky strategy for reaching a preferred state amid superintelligent AI risks. Yudkowsky warns of catastrophic outcomes if AGI is not controlled, while Miller advocates decentralizing power and preserving human institutions as AI evolves.The conversation spans AI collaboration, secure operating frameworks, cryptographic separation, and lessons from nuclear non-proliferation. Despite their differences, both aim for a future where AI benefits humanity without posing existential threats. Hosted on Acast. See acast.com/privacy for more information.

This is a teaser episode of the Existential Hope Podcast with Nobel Laureate David Baker. David reveals how scientists are now inventing entirely new proteins—life's fundamental building blocks—to tackle some of the world's most pressing challenges.David shares his journey and his vision for a future where custom-built "molecular machines," an idea once explored by thinkers like Eric Drexler, could repair our bodies, clean up pollution, and create sustainable materials. He explains how breakthroughs in AI are supercharging this field, but also why human ingenuity and collaborative science are still essential to unlocking these revolutionary possibilities.In this conversation, we explore:The incredible power of designing brand-new proteins for groundbreaking medicines, environmental cleanup, and creating novel materials.The exciting prospect of "molecular machines": tiny engines built from proteins to perform complex tasks, inspired by early visions of nanotechnology.How AI is accelerating scientific discovery, and what it takes to translate these digital designs into real-world solutions.David’s "communal brain" philosophy for fostering innovation and his advice for anyone wanting to solve big, meaningful problems.Listen to the full episode on the Existential Hope podcast on here on Apple or here on Spotify or wherever you get your podcasts. Hosted on Acast. See acast.com/privacy for more information.

This feed is now Foresight Institute Radio—your place for standout talks on frontier technology: from AI and neurotech to nanotech, longevity, and space. You’ll hear highlights from Foresight’s global conferences and seminars featuring top scientists and builders.For long-form interviews, follow our sister show: The Existential Hope Podcast, with guests like David Baker, Steven Pinker, and David Deutsch.Want the slides? Subscribe on YouTube and follow us on X @ForesightInst.🎤 Featuring: Allison Duettmann, CEO of Foresight Institute🎥 Slides + videos: YouTube.com/ForesightInstitute🐦 Updates: X.com/ForesightInst Hosted on Acast. See acast.com/privacy for more information.

What happens when parents can choose their children's genetic traits, and which selections benefit society versus harm it? In this talk, Jonathan Anomaly explores the emerging field of embryo selection for intelligence, disease prevention, and longevity. He covers how polygenic risk scores work to predict complex traits and why most diseases involve thousands of genetic variants rather than single genes.Jonathan Anomaly is a former professor who spent 15 years studying the intersection of game theory and ethics, focusing on collective action problems. He recently co-founded a stealth company that will be among the first to offer embryo selection for intelligence and disease prevention.This talk was recorded at Vision Weekend Puerto Rico 2025. To see the slides and more talks from the event, please visit our Youtube channel. Hosted on Acast. See acast.com/privacy for more information.

What if you could diagnose stroke, treat cancer, and cure depression with a smartphone-sized device that costs $1,000 instead of millions? In this talk, Mary Lou Jepsen demonstrates her revolutionary handheld medical devices that use ultrasound and infrared light to selectively target diseased cells while leaving healthy tissue unharmed. She covers how her team achieved 100% remission in deadly glioblastoma cancer in mice, moved nearly half of treatment-resistant depression patients into remission, and why making all 68 patents open source could democratize healthcare globally while reducing medical device costs by 93%.Mary Lou Jepsen is a serial hardtech entrepreneur and former MIT professor with a PhD in physics from Brown University. She previously founded multiple multi-billion dollar companies, left Facebook to start her current venture, and recently raised $54 million to bring these breakthrough medical technologies to market as open-source solutions.This talk was recorded at Vision Weekend US 2024. To see the slides and more talks from the event, please visit our Youtube channel. Hosted on Acast. See acast.com/privacy for more information.

What if a government agency could fund transformative health research with $200 million budgets and no bureaucratic committees? In this talk, Jean Hebert explores ARPA-H's – a research funding agency – unique mission to accelerate health breakthroughs, from 3D-printed organs to functional eye transplants. He covers how ARPA-H operates differently from traditional government funding through autonomous program managers, why it presents exceptional opportunities for longevity researchers, and how both established scientists and entrepreneurs can engage with this well-funded agency that's aligned with life extension goals.Jean Hebert is a professor of genetics and neuroscience, and the author of "Replacing Aging". He currently serves as a Program Manager at ARPA-H. His personal mission remains unchanged: to beat aging, which he believes is achievable through replacement therapies and transformative approaches to life extension.This talk was recorded at Vision Weekend US 2024. To see the slides and more talks from the event, please visit our Youtube channel. Hosted on Acast. See acast.com/privacy for more information.

How has the history of AI been shaped by the "bitter lesson" that simple scaling beats complex algorithms, and what comes next? In this talk, Irina Rish traces AI's evolution from rule-based systems to today's foundation models, exploring how scaling laws predicted performance improvements and recent shifts toward more efficient approaches. She covers the progression from GPT scaling laws to Chinchilla's compute-optimal training, the rise of inference-time computation with models like OpenAI's o1, and why we might need to move beyond transformers to truly brain-inspired dynamical systems.Irina Rish is a professor at the University of Montreal and Mila Quebec AI Institute. She also co-founded a startup focused on developing more efficient foundation models and recently released a suite of open-source compressed models.This talk was recorded at Vision Weekend Puerto Rico 2025. To see the slides and more talks from the event, please visit our YouTube channel. Hosted on Acast. See acast.com/privacy for more information.

Eric Gilliam studies how organizations like Bell Labs, early MIT, and the Rockefeller Foundation helped drive scientific progress — and what made them unusually effective.In this conversation, we explore how those models worked, why many of them disappeared, and what it would take to bring them back. Eric explains why fast-moving, engineering-driven labs like BBN (which built the first nodes of the internet) may be essential to accelerating progress in fields like AI, biotech, and beyond.We also cover:Why most funders underuse applied historyHow systems engineers at Bell Labs identified billion-dollar problemsWhat a $100M research organization should do differentlyWhat makes Eric hopeful about the future of meta-scienceEric runs FreakTakes, a Substack focused on the organizational infrastructure of scientific progress. He’s a fellow at the Good Science Project and works with ARIA UK and Renaissance Philanthropy to support new models for R&D.Full transcript, list of resources, and art piece: https://www.existentialhope.com/podcastsExistential Hope was created to collect positive and possible scenarios for the future so that we can have more people commit to creating a brighter future, and to begin mapping out the main developments and challenges that need to be navigated to reach it. Existential Hope is a Foresight Institute project.Hosted by Allison Duettmann and Beatrice ErkersFollow Us: Twitter | Facebook | LinkedIn | Existential Hope InstagramExplore every word spoken on this podcast through Fathom.fm. Hosted on Acast. See acast.com/privacy for more information.

Most AI discussions focus on its risks to democracy – disinformation, surveillance, centralization of power. But what if AI could make governance better?Glen Weyl, political economist at Microsoft Research and founder of RadicalxChange, argues that AI could be used to create more participatory, decentralized, and democratic systems, if we design it right. In this interview, he explores what AI governance could look like if we tried to use it for real pluralism.This interview is a guest lecture in our online course about shaping positive futures with AI. The course is free, and available here: https://www.udemy.com/course/worldbuilding-hopeful-futures-with-ai/ Hosted on Acast. See acast.com/privacy for more information.

How can storytelling shape our visions of the future? Ada Palmer—historian, science fiction writer, and futurist—brings a unique perspective on how worldbuilding can be a powerful tool for exploring complex ideas. In this conversation with Beatrice Erkers, she shares her perspective on worldbuilding and storytelling, and her recommendations for how we can think in new ways about the future.This interview is a guest lecture in our new online course about shaping positive futures with AI. The course is free, and available here: https://www.udemy.com/course/worldbuilding-hopeful-futures-with-ai/ Hosted on Acast. See acast.com/privacy for more information.

How we develop AI will shape the future of society. In this interview, Anthony Aguirre explores the distinction between Tool AI and Replacement AI, and how this framing can inform AI policy, governance, and strategy. He shares insights on the risks and thresholds of AGI, the role of capability, agency, and autonomy in AI development, and what it means to keep the future human as AI systems become more advanced and integrated into society.Anthony Aguirre is a Professor in Physics, and the Executive Director & Secretary of the Board at the Future of Life Institute.This interview is a guest lecture in our new online course about shaping positive futures with AI. The course is free, and available here: https://www.udemy.com/course/worldbuilding-hopeful-futures-with-ai/ Hosted on Acast. See acast.com/privacy for more information.

Who makes the rules for AI? Right now, a handful of companies and governments are shaping its trajectory – but what happens behind closed doors? Helen Toner, Director of Strategy at Georgetown’s CSET and former OpenAI board member, has been inside some of the biggest AI governance conversations. In this conversation with Beatrice Erkers, she shares an insider’s take on AI policy, US-China dynamics, and what’s coming next in AI regulation.This interview is a guest lecture in our new online course about shaping positive futures with AI. The course is free, and available here: https://www.udemy.com/course/worldbuilding-hopeful-futures-with-ai/ Hosted on Acast. See acast.com/privacy for more information.

What if parenting held the keys to civilization’s long-term flourishing?In this deeply personal and philosophically rich episode of the Existential Hope podcast, we sit down with Dr. Aaron Stupple – physician, thinker, and author of The Sovereign Child. Drawing from the rationalist traditions of David Deutsch and Karl Popper, and grounded in the parenting philosophy of "Taking Children Seriously," Aaron explores what it means to treat children as full moral agents from birth.From screen time and sugar to sleep and sovereignty, Aaron shares how applying rigorous epistemology to parenting transformed his relationship with his children — and how it might transform the future of civilization itself.Key TopicsApplying Popperian epistemology to parentingWhy children are not "pre-persons" but full moral agentsMoving beyond control vs. permissivenessReal-life examples: screens, food, bedtime, and educationParenting as civilizational infrastructure for a better futureFull transcript, list of resources, and art piece: https://www.existentialhope.com/podcastsExistential Hope was created to collect positive and possible scenarios for the future so that we can have more people commit to creating a brighter future, and to begin mapping out the main developments and challenges that need to be navigated to reach it. Existential Hope is a Foresight Institute project.Hosted by Allison Duettmann and Beatrice ErkersFollow Us: Twitter | Facebook | LinkedIn | Existential Hope InstagramExplore every word spoken on this podcast through Fathom.fm. Hosted on Acast. See acast.com/privacy for more information.

The way we talk about the future of the planet often feels like a choice between denial and doomism. But what if we looked at the data? Hannah Ritchie, Deputy Editor at Our World in Data, has dedicated her work to making complex global challenges—like climate change, energy, and sustainability—more understandable and actionable. In this conversation with Beatrice Erkers, she shares insights from her book Not the End of the World, exploring what the data actually tells us about humanity’s progress, where technology—including AI—can help, and how we can build a future that is not just survivable, but sustainable and hopeful.This interview is a guest lecture in our new online course about shaping positive futures with AI. The course is free, and available here: https://www.udemy.com/course/worldbuilding-hopeful-futures-with-ai/ Hosted on Acast. See acast.com/privacy for more information.

In this special “minisode” of the Existential Hope podcast, Allison and Beatrice from Foresight Institute sit down to discuss their newly launched, free worldbuilding course on Udemy: The AI Futures Worldbuilding course. This course—created in partnership with the Future of Life Institute—helps participants imagine and shape positive visions for AI’s impact on technology, governance, economics, and everyday life.Hear about expert guest lectures from leaders like Anousheh Ansari (XPRIZE), Helen Toner (CSET), Hannah Ritchie (Our World in Data), Ada Palmer (University of Chicago), Anthony Aguirre (FLI), and more. If you’re curious how to chart a better future with AI, or simply need a dose of optimism, tune in for practical insights and inspiring ideas.• Take the course – Search for “Building Hopeful Futures with AI” on Udemy or visit existentialhope.com• Submit your vision – Share your optimistic vision for 2035 using the form at existentialhope.com, and explore submissions from others.• Spread the word – If you know someone who could use a hopeful perspective on our AI future, invite them to join this journey!Learn more about the course: https://www.udemy.com/course/worldbuilding-hopeful-futures-with-ai/  Existential Hope was created to collect positive and possible scenarios for the future so that we can have more people commit to creating a brighter future, and to begin mapping out the main developments and challenges that need to be navigated to reach it. Existential Hope is a Foresight Institute project.Hosted by Allison Duettmann and Beatrice ErkersFollow Us: Twitter | Facebook | LinkedIn | Existential Hope InstagramExplore every word spoken on this podcast through Fathom.fm. Hosted on Acast. See acast.com/privacy for more information.

Zac Hatfield-Dodds is a member of the technical staff at Anthropic. In this episode he talks about Anthropic's responsible scaling policy.About Foresight InstituteForesight Institute is a research organization and non-profit that supports the beneficial development of high-impact technologies. Since our founding in 1987 on a vision of guiding powerful technologies, we have continued to evolve into a many-armed organization that focuses on several fields of science and technology that are too ambitious for legacy institutions to support.Get Involved with Foresight:Apply to our virtual technical seminars Join our in-person events and workshops Donate: Support Our Work – If you enjoy what we do, please consider this, as we are entirely funded by your donations!Follow Us: Twitter | Facebook | LinkedIn Hosted on Acast. See acast.com/privacy for more information.

In this episode of the Existential Hope Podcast, existential psychologist Clay Routledge explores how meaning and agency shape both individual well-being and societal progress.While material conditions have improved, many people—especially younger generations—report growing pessimism and disconnection. Clay argues that a lack of meaning, not just external barriers, often holds us back. By understanding how humans derive purpose and motivation, we can unlock new paths to flourishing.We discuss:Why agency—the belief that we can shape our future—is crucial for progressHow nostalgia can fuel innovation rather than trap us in the pastThe difference between hope and optimism, and why hope drives actionThe psychology behind rising pessimism and how to counter itWhat a world that maximizes meaning and human potential could look likeIf you’ve ever wondered how psychology can help us move from existential angst to existential hope, this episode is for you.Full transcript, list of resources, and art piece: https://www.existentialhope.com/podcastsExistential Hope was created to collect positive and possible scenarios for the future so that we can have more people commit to creating a brighter future, and to begin mapping out the main developments and challenges that need to be navigated to reach it. Existential Hope is a Foresight Institute project.Hosted by Allison Duettmann and Beatrice ErkersFollow Us: Twitter | Facebook | LinkedIn | Existential Hope InstagramExplore every word spoken on this podcast through Fathom.fm. Hosted on Acast. See acast.com/privacy for more information.

Cate Hall is the CEO of Astera. She’s a former Supreme Court attorney and the ex-No. 1 female poker player in the world. Before joining Astera, she co-founded and served as COO and later co-CEO of Alvea, a pandemic medicine company that set the record for the fastest startup to take a drug candidate to Phase I clinical trial. She received a BS in biochemistry and BA in philosophy from the University of Arizona, and a law degree from Yale Law School.About Foresight InstituteForesight Institute is a research organization and non-profit that supports the beneficial development of high-impact technologies. Since our founding in 1987 on a vision of guiding powerful technologies, we have continued to evolve into a many-armed organization that focuses on several fields of science and technology that are too ambitious for legacy institutions to support.Get Involved with Foresight:Apply to our virtual technical seminars Join our in-person events and workshops Donate: Support Our Work – If you enjoy what we do, please consider this, as we are entirely funded by your donations!Follow Us: Twitter | Facebook | LinkedIn Hosted on Acast. See acast.com/privacy for more information.

Sam Rodriques is an inventor and entrepreneur. In 2023, he launched FutureHouse, a new research lab in San Francisco focused on building an AI Scientist. He previously ran the Applied Biotechnology Lab at the Francis Crick Institute. Before that, he did his PhD at MIT. Sam also proposed the Focused Research Organization model, which is now being used by a number of philanthropic funders and governments to facilitate scientific moonshots.About Foresight InstituteForesight Institute is a research organization and non-profit that supports the beneficial development of high-impact technologies. Since our founding in 1987 on a vision of guiding powerful technologies, we have continued to evolve into a many-armed organization that focuses on several fields of science and technology that are too ambitious for legacy institutions to support.Get Involved with Foresight:Apply to our virtual technical seminars Join our in-person events and workshops Donate: Support Our Work – If you enjoy what we do, please consider this, as we are entirely funded by your donations!Follow Us: Twitter | Facebook | LinkedIn Hosted on Acast. See acast.com/privacy for more information.

Tom Kalil is the CEO of Renaissance Philanthropy. Tom served in the White House for two presidents (Obama and Clinton) and in collaboration with his team worked with the Senate to give every federal agency the authority to support incentive prizes for up to $50 million. Tom also designed and launched dozens of White House science and technology initiatives, including the $40 billion National Nanotechnology Initiative, announced by President Clinton; The BRAIN Initiative, announced by President Obama; The Next Generation Internet initiative, announced by President Clinton and Vice President Gore; and initiatives in advanced materials, robotics, smallsats, data science, and EdTech. About Foresight InstituteForesight Institute is a research organization and non-profit that supports the beneficial development of high-impact technologies. Since our founding in 1987 on a vision of guiding powerful technologies, we have continued to evolve into a many-armed organization that focuses on several fields of science and technology that are too ambitious for legacy institutions to support.Allison DuettmannThe President and CEO of Foresight Institute, Allison Duettmann directs the Intelligent Cooperation, Molecular Machines, Biotech & Health Extension, Neurotech, and Space Programs, alongside Fellowships, Prizes, and Tech Trees. She has also been pivotal in co-initiating the Longevity Prize, pioneering initiatives like Existentialhope.com, and contributing to notable works like "Superintelligence: Coordination & Strategy" and "Gaming the Future".Get Involved with Foresight:Apply to our virtual technical seminars Join our in-person events and workshops Donate: Support Our Work – If you enjoy what we do, please consider this, as we are entirely funded by your donations!Follow Us: Twitter | Facebook | LinkedInNote: Explore every word spoken on this podcast through Fathom.fm, an innovative podcast search engine. Hosted on Acast. See acast.com/privacy for more information.