Concepedia

Communication-efficient Training

Communication-Efficient Training is a methodological framework in distributed machine learning that minimizes inter-node communication overhead during model training while preserving convergence performance through techniques such as gradient compression, sparsification, or infrequent synchronization.

373

Publications

33.6K

Citations

1.2K

Authors

347

Institutions

Publications per year

2017–2026

340

Parents

Publications

373

Communication-Efficient Learning of Deep Networks from Decentralized Data

H. Brendan McMahan, Eider Moore, Daniel Ramage et al. · arXiv (Cornell University) · 2016 · 5.2K citations · Full text

, , +14

Federated Learning: Strategies for Improving Communication Efficiency

Jakub Konečný, H. Brendan McMahan, Felix X. Yu et al. · arXiv (Cornell University) · 2016 · 3K citations · Full text

, , +13

Federated Optimization: Distributed Machine Learning for On-Device Intelligence

Jakub Konečný, H. Brendan McMahan, Daniel Ramage et al. · arXiv (Cornell University) · 2016 · 1.7K citations · Full text

, , +13

On the Convergence of FedAvg on Non-IID Data

Xiang Li, Kaixuan Huang, Wenhao Yang et al. · arXiv (Cornell University) · 2019 · 1K citations · Full text

, , +12

QSGD: Communication-Efficient SGD via Gradient Quantization and Encoding

Dan Alistarh, Demjan Grubic, Jerry Li et al. · arXiv (Cornell University) · 2016 · 912 citations · Full text

, , +17

1–5 of 373

Authors

1.2K

  1. MB
    Mehdi Bennis

    University of Oulu, Finland

    14 publications · 1.1K citations

    14

    h-index

  2. JP
    Jihong Park

    University of Oulu, Finland

    13 publications · 1K citations

    13

    h-index

  3. MJ
    Martin Jaggi

    École Polytechnique Fédérale de Lausanne, Switzerland

    13 publications · 921 citations

    12

    h-index

  4. PR
    Peter Richtárik

    University of Edinburgh, United Kingdom

    10 publications · 5.1K citations

    10

    h-index

  5. SS
    Shaohuai Shi

    Hong Kong Baptist University, Hong Kong SAR China

    9 publications · 544 citations

    9

    h-index

1–5 of 1.2K

Institutions

347

  1. Hong Kong University of Science and Technology

    Hong Kong, Hong Kong

    17 h-index

    29 publications

    1.9K citations

  2. École Polytechnique Fédérale de Lausanne

    Lausanne, Switzerland

    11 h-index

    26 publications

    2.2K citations

  3. University of Science and Technology of China

    Hefei, China

    10 h-index

    34 publications

    3K citations

  4. Peng Cheng Laboratory

    Shenzhen, China

    10 h-index

    13 publications

    913 citations

  5. University of Oulu

    Oulu, Finland

    10 h-index

    27 publications

    1.4K citations

  6. University of California, Berkeley

    Berkeley, United States

    9 h-index

    19 publications

    747 citations

  7. Hong Kong Baptist University

    Hong Kong, Hong Kong

    8 h-index

    16 publications

    803 citations

  8. Rensselaer Polytechnic Institute

    Troy, United States

    7 h-index

    9 publications

    331 citations

1–8 of 347

Venues

  1. arXiv (Cornell University)

    Repository · 131 publications · 20.1K citations

    46

    h-index

  2. IEEE Transactions on Parallel and Distributed Systems

    TPDS · 14 publications · 1.2K citations

    14

    h-index

  3. IEEE Internet of Things Journal

    15 publications · 1.1K citations

    14

    h-index

  4. IEEE Journal on Selected Areas in Communications

    10 publications · 720 citations

    9

    h-index

  5. Proceedings of the AAAI Conference on Artificial Intelligence

    Conference · 8 publications · 293 citations

    8

    h-index

1–5