Episode 151
Multi-Instance GPUs, with Kevin Klues and Pradeep Venkatachalam
Kubernetes Podcast from Google · Kubernetes Podcast from Google
June 11, 202130m 59s
Audio is streamed directly from the publisher (traffic.libsyn.com) as published in their RSS feed. Play Podcasts does not host this file. Rights-holders can request removal through the copyright & takedown page.
Show Notes
NVIDIA and Google have teamed up to bring the new Multi-Instance GPU feature, launched with the NVIDIA A100, to GKE. We speak to Kevin Klues from NVIDIA and Pradeep Venkatachalam from Google Cloud on how and why people use GPUs, optimising instance shapes for machine learning, and why less is often more.
Do you have something cool to share? Some questions? Let us know:
- web: kubernetespodcast.com
- mail: [email protected]
- twitter: @kubernetespod
- Azure App Services now available for Azure Arc
- ECS Anywhere made GA by press release
- AWS App Runner
- Integrating Google Cloud DNS with GKE
- Istio 1.10
- Terraform 1.0
- Grafana 8.0 and Tempo 1.0
- Argo Rollouts 1.0
- Kubesphere 3.1.0
- Cilium 1.10
- OpenSLO spec launched at SLOConf
- Envoy GA on Windows
- Chaos Experimentation Framework for Envoy
- El Carro operator for Oracle Database from Google Cloud
- Moco operator for MySQL from Kintone
- PlanetScale GA
- FoundationDB paper from ACM SIG MOD
- DockerCon announcements
- Coverage of Development Environments from The Register
- Deps: Open Source Insights project from Google
- Verifiable Supply Chain Metadata with Tekton Chains
- Kubernetes CVEs:
- runc CVE-2021-30465
- VS Code Plugin for Kubernetes CVE-2021-31938
- Steve Smith says "GitOps is a placebo" in a blog post and Twitter thread
- Styra raises $40m Series B round
- Cloud Native community goes live with 10 shows on something called Twitch
- YouTube playlist for KubeCon EU 2021
- Episode 92, with Pramod Ramarao
- Dogecoin
- Training and inference
- 12 things that prove Doom will run on literally anything
- "It runs Doom" subreddit
- CUDA
- vGPUs
- Multi-Instance GPUs
- GKE now supports multi-instance GPUs
- 7 core MacBook Air GPUs
- A100 GPU
- 16 A100 GPUs on a Google Cloud VM
- Running GPUs on GKE
- NVIDIA Container Toolkit
- GCP NVIDIA GPU device plugin
- Kubernetes NVIDIA device plugin
- GTC 2021 talks:
- A Deep Dive on Supporting Multi-Instance GPUs in Containers and Kubernetes by Kevin and Pradeep
- Gain Competitive Advantage using ML Ops: Kubeflow and NVIDIA Merlin and Google Cloud by Andrew Stein and Maulin Patel (Google) and Davide Onofrio (NVIDIA)
- Kevin's KubeCon talk and slides
- Kevin Klues on Twitter