The GPU Gold Rush: How Vast.ai Scaled With AI Demand
ProductLed Podcast · Wes Bush and Esben Friis-Jensen
Audio is streamed directly from the publisher (chtbl.com) as published in their RSS feed. Play Podcasts does not host this file. Rights-holders can request removal through the copyright & takedown page.
Show Notes
In this episode of the ProductLed Podcast, Wes Bush and Esben Friis-Jensen sit down with Travis Cannell, CEO and first employee at Vast.ai, the marketplace for on-demand, low-cost GPUs powering AI workloads around the world.
Travis breaks down one of the biggest shifts happening in AI right now: the rise of inference. He explains why inference demand is exploding, how that shift is fueling Vast.ai’s rapid growth, and why more teams are looking for flexible, affordable GPU access outside of traditional cloud platforms.
The conversation also gets into how Vast.ai built a two-sided GPU marketplace with 20,000 GPUs, why its pricing model creates powerful marketplace dynamics, and what makes its software-first approach difficult to replicate. Travis shares how the company thinks about competition, customer support, GPU hosting economics, and why winning in a fast-growing marketplace depends on much more than just low prices.
They also explore how AI is changing org design inside high-growth companies. Travis talks candidly about pausing hiring, using AI to accelerate engineering work, and why Vast.ai has leaned into an in-office culture while staying extremely lean.
If you want a clearer picture of where AI infrastructure is heading, and how one company is scaling quickly with a software-first model, this episode is packed with insight.
Key Highlights:
- 02:34 - Why Inference Is Fueling the Next AI Boom
- 04:15 - Inference Explained in Plain English
- 06:15 - The Moment Vast.ai Hit Hypergrowth
- 10:04 - Why Teams Choose Vast Over AWS
- 12:34 - Building a Two-Sided GPU Marketplace
- 17:03 - Competing on More Than Just Price
- 18:52 - The Real Economics of Hosting GPUs
- 25:21 - The Network Effects Behind Vast.ai
- 31:31 - Building a Lean Team During Hypergrowth
- 36:09 - Why AI Changed Their Hiring Strategy
Resources:
- 🚀 Vast.ai: Marketplace for low-cost GPUs: https://vast.ai
- 💼 Connect with Travis Cannell on LinkedIn: https://www.linkedin.com/in/traviscannell/
- 💼 Connect with Wes Bush on LinkedIn: https://www.linkedin.com/in/wesbush/
- 💼 Connect with Esben Friis-Jensen on LinkedIn: https://www.linkedin.com/in/esbenfriisjensen/
- 🧠 Sign up for the ProductLed Newsletter: https://www.productled.com/newsletter