Episode 39
CUDA graphs
What are CUDA graphs? How are they implemented? What does it take to actually use them in PyTorch?
June 28, 202113m 55s
Audio is streamed directly from the publisher (cdn.simplecast.com) as published in their RSS feed. Play Podcasts does not host this file. Rights-holders can request removal through the copyright & takedown page.
Show Notes
What are CUDA graphs? How are they implemented? What does it take to actually use them in PyTorch?
Further reading.
- NVIDIA has docs on CUDA graphs https://developer.nvidia.com/blog/cuda-graphs/
- Nuts and bolts implementation PRs from mcarilli: https://github.com/pytorch/pytorch/pull/51436 https://github.com/pytorch/pytorch/pull/46148