PLAY PODCASTS
Microsoft’s Mustafa Suleyman Warns Against the Illusion of Conscious AI: “Build AI for People, Not to Be a Person”
Episode 540

Microsoft’s Mustafa Suleyman Warns Against the Illusion of Conscious AI: “Build AI for People, Not to Be a Person”

Microsoft AI CEO Mustafa Suleyman warns that believing AI is conscious could lead to mental health risks and misguided calls for AI rights.

Cloud Wars Live with Bob Evans · Kieron Allen

September 5, 20252m 30s

Audio is streamed directly from the publisher (pscrb.fm) as published in their RSS feed. Play Podcasts does not host this file. Rights-holders can request removal through the copyright & takedown page.

Show Notes

Highlights

00:03 — Microsoft AI CEO Mustafa Suleyman has published a blog post that criticizes the notion of seemingly conscious AI. He argues that the pursuit of this idea, particularly regarding AI model welfare, is misguided.

00:19 — Suleyman explains that these concepts are already causing mental health issues among users. He is growing: “more and more concerned about what is becoming known as the psychosis risk and a bunch of related issues. I don’t think this will be limited to those who are already at risk of mental health issues.”

00:56 — Suleyman argues that we should “build AI for people not to be a person.” He is adamant in his neglect of this previous approach, saying that: “The arrival of seemingly conscious AI is inevitable and unwelcome. Instead, we need a vision for AI that can fulfill its potential as a helpful companion without falling prey to its illusions.”

AI Agent & Copilot Summit is an AI-first event to define opportunities, impact, and outcomes with Microsoft Copilot and agents. Building on its 2025 success, the 2026 event takes place March 17-19 in San Diego. Get more details.

 

01:18 — Meanwhile, companies like Anthropic, OpenAI, and Google DeepMind are actively pursuing AI consciousness or welfare research. Now, while there are complications and not everyone is on the same page, here, it is clear that the evolving scenarios and possibilities presented by AI are increasingly reaching into the realm of the surreal and in some cases, they’re fantastical.

01:42 — This is largely because, for the first time in human history, we have a tool that is evolving at a pace beyond which we can conceive. While some of these ideas may sound far-fetched, the warnings accompanying them are serious based on real concerns coming from leaders in the AI space, the ones leading this new AI revolution.

02:04 — What everyone must do, and though it will be challenging, is to start imagining the unimaginable. Once you accept the vast possibilities of AI, both good and bad, you can begin to take the warnings that come with them seriously.

Visit Cloud Wars for more.

Topics

kieron allenmicrosoft