Accelerating Collective Communication in Data Parallel Training across Deep Learning Frameworks
Published in NSDI, 2022
Joshua Romero, Junqi Yin, Nouamane Laanait, Bing Xie, M. Todd Young, Sean Treichler, Vitalii Starchenko, Albina Borisevich, Alex Sergeev, Michael Matheson
Download here