Edge#9: Come across Parallel Training

In this issue:

• we discuss the concept of parallel training; 

• we review a famous OpenAI research paper that proposes GNS, a metric to measure training scalability; 

• we join Horovod, not the dance though but the parallel training framework created by Uber. 

Enjoy the learning!