Shaohuai Shi

Highly Scalable Deep Learning Training System with Mixed-Precision: Training ImageNet in Four Minutes

Xianyan Jia, Shutao Song, Wei He et al. · arXiv (Cornell University) · 2018 · 313 citations · Full text

Cluster Computing, Convolutional Neural Network, Engineering +19

Benchmarking State-of-the-Art Deep Learning Software Tools

Shaohuai Shi, Qiang Wang, Pengfei Xu et al. · 2016 · 301 citations

Benchmarking Tool, Engineering, Machine Learning +14

A Distributed Synchronous SGD Algorithm with Global Top-k Sparsification for Low Bandwidth Networks

Shaohuai Shi, Qiang Wang, Kaiyong Zhao et al. · 2019 · 162 citations

Cluster Computing, Engineering, Machine Learning +23

GossipFL: A Decentralized Federated Learning Framework With Sparsified and Adaptive Communication

Zhenheng Tang, Shaohuai Shi, Bo Li et al. · IEEE Transactions on Parallel and Distributed Systems · 2022 · 126 citations

Engineering, Machine Learning, Distributed Algorithms +17

Performance Modeling and Evaluation of Distributed Deep Learning Frameworks on GPUs

Shaohuai Shi, Qiang Wang, Xiaowen Chu · 2018 · 114 citations

Cluster Computing, Engineering, Machine Learning +17