Episode 4
Vectorization
What is vectorization? How do you use it in PyTorch? What are some of the traps and pitfalls of writing vectorized code in PyTorch?
May 7, 202114m 35s
Audio is streamed directly from the publisher (cdn.simplecast.com) as published in their RSS feed. Play Podcasts does not host this file. Rights-holders can request removal through the copyright & takedown page.
Show Notes
What is vectorization? How do you use it in PyTorch? What are some of the traps and pitfalls of writing vectorized code in PyTorch?
Further reading:
- native/cpu README https://github.com/.../aten/src/ATen/native/cpu/README.md
- Vec256 classes https://github.com/.../tree/master/aten/src/ATen/cpu/vec256
- AVX512 support tracking issue https://github.com/pytorch/pytorch/issues/56187