Building Infrastructure for AI Training & Inferencing
How do you define infrastructure to support infer…
June 7, 202431m 14s
Audio is streamed directly from the publisher (feeds.soundcloud.com) as published in their RSS feed. Play Podcasts does not host this file. Rights-holders can request removal through the copyright & takedown page.
Show Notes
How do you define infrastructure to support inferencing? Today we discuss that and more, including training. We walk through what it's going to take to understand what to buy, what to build, how to build, how to put it together, and how hard it is to actually know what goes into the infrastructure behind an AI cluster. Importantly, exploring why we don't have the answers is the first phase of understanding.
Transcript: https://otter.ai/u/2SIZyiLDtfyi_zGrol8qHvHc0gA?utm_source=copy_url