Episode 67
Training neural networks faster without GPU (Ep. 71)
August 6, 201922m 21sExplicit
Audio is streamed directly from the publisher (mcdn.podbean.com) as published in their RSS feed. Play Podcasts does not host this file. Rights-holders can request removal through the copyright & takedown page.
Show Notes
Training neural networks faster usually involves the usage of powerful GPUs. In this episode I explain an interesting method from a group of researchers from Google Brain, who can train neural networks faster by squeezing the hardware to their needs and making the training pipeline more dense.
Enjoy the show!
ReferencesFaster Neural Network Training with Data Echoing
https://arxiv.org/abs/1907.05550