Gradient Compression is a method in scalable machine learning that reduces the communication overhead during model updates by selectively retaining or quantizing the most informative components of gradient vectors while discarding less significant information.
151
Publications
9K
Citations
490
Authors
160
Institutions
Publications per year
2017–2026
130
Publications
151
Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Training
Yujun Lin, Song Han, Huizi Mao et al. · arXiv (Cornell University) · 2017 · 647 citations · Full text
Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Training
Yujun Lin, Song Han, Huizi Mao et al. · arXiv (Cornell University) · 2018 · 577 citations · Full text
Communication-efficient federated learning via knowledge distillation
Chuhan Wu, Fangzhao Wu, Lingjuan Lyu et al. · Nature Communications · 2022 · 555 citations · Full text
Sparse Communication for Distributed Gradient Descent
2017 · 506 citations · Full text
1–5 of 151
Authors
490
- PR
10
h-index
- SUSebastian U. Stich
École Polytechnique Fédérale de Lausanne, Switzerland
8 publications · 401 citations
8
h-index
- SPSai Praneeth Karimireddy
École Polytechnique Fédérale de Lausanne, Switzerland
5 publications · 425 citations
5
h-index
- MCMarco Canini
King Abdullah University of Science and Technology, Saudi Arabia
5 publications · 144 citations
5
h-index
- AM
5
h-index
1–5 of 490
Institutions
160
King Abdullah University of Science and Technology
Jeddah, Saudi Arabia
10 h-index
35 publications
1.2K citations
École Polytechnique Fédérale de Lausanne
Lausanne, Switzerland
8 h-index
18 publications
1.3K citations
University of California, Los Angeles
Los Angeles, United States
5 h-index
14 publications
289 citations
University of Southern California
Los Angeles, United States
5 h-index
18 publications
432 citations
Tsinghua University
Beijing, China
5 h-index
16 publications
4.4K citations
University of Illinois Urbana-Champaign
Urbana, United States
5 h-index
12 publications
707 citations
Kootenay Association for Science & Technology
Rossland, Canada
5 h-index
24 publications
674 citations
Amazon (United States)
Seattle, United States
5 h-index
8 publications
149 citations
1–8 of 160
Venues
- arXiv (Cornell University)
Repository · 55 publications · 3.5K citations
29
h-index
- Proceedings of the AAAI Conference on Artificial Intelligence
Conference · 6 publications · 865 citations
6
h-index
- IEEE Transactions on Communications
4 publications · 118 citations
4
h-index
- PubMed
Repository · 3 publications · 76 citations
3
h-index
- IEEE Transactions on Neural Networks and Learning Systems
3 publications · 155 citations
3
h-index
1–5