Episode 72: training neural networks faster without GPU
Aug 6th, 2019 by frag
Training neural networks faster usually involves the usage of powerful GPUs. In this episode I explain an interesting method from a group of researchers from Google Brain, who can train neural networks faster by squeezing the hardware to their needs and making the training pipeline more dense.
Enjoy the show!
Faster Neural Network Training with Data Echoing