PLAY PODCASTS
AI is eating up the world's computing memory

AI is eating up the world's computing memory

Marketplace Tech

January 13, 20267m 53s

Audio is streamed directly from the publisher (pscrb.fm) as published in their RSS feed. Play Podcasts does not host this file. Rights-holders can request removal through the copyright & takedown page.

Show Notes

Much like graphics processing units, high bandwidth memory is essential for training and running AI. It's paired with all those NVIDIA chips that have been selling like hotcakes and only a small handful companies in the world make it. Now the surge in demand from data centers has created a global shortage for everything else — the PCs and smartphones and other consumer electronics that also use memory chips. Marketplace’s Meghan McCarty Carino spoke with Tom Mainelli, vice president of device and consumer research at IDC, about how long this shortage could last.