Concepedia

All-gather

All-Gather is a collective communication operation in parallel computing where each process contributes a data element to a globally aggregated dataset, and the complete set of contributions from all processes is distributed back to every process.

9

Publications

281

Citations

32

Authors

10

Institutions

Publications per year

2017–2026

1

Variants

All-gather Operation

Parents

Publications

9

BlueConnect: Decomposing all-reduce for deep learning on heterogeneous network hierarchy

Min Chul Cho, Ulrich Finkler, Maurício Serrano et al. · IBM Journal of Research and Development · 2019 · 87 citations

, , +17

Using overlays for efficient data transfer over shared wide-area networks

Gaurav Khanna, Ümit V. Çatalyürek, Tahsin Kurç et al. · 2008 · 35 citations

, , +13

HierKNEM: An Adaptive Framework for Kernel-Assisted and Topology-Aware Collective Communications on Many-core Clusters

Teng Ma, George Bosilca, Aurélien Bouteiller et al. · 2012 · 33 citations

, , +17

Process Distance-Aware Adaptive MPI Collective Communications

Teng Ma, Thomas Hérault, George Bosilca et al. · 2011 · 32 citations

, , +17

Using overlays for efficient data transfer over shared wide-area networks

Gaurav Khanna, Ümit V. Çatalyürek, Tahsin Kurç et al. · 2008 · 30 citations

, , +13

1–5 of 9

Authors

32

  1. PS
    P. Sadayappan

    The Ohio State University, United States

    2 publications · 65 citations

    2

    h-index

  2. JD
    Jack Dongarra

    University of Tennessee at Knoxville, United States

    2 publications · 65 citations

    2

    h-index

  3. TK
    Tahsin Kurç

    The Ohio State University, United States

    2 publications · 65 citations

    2

    h-index

  4. GB
    George Bosilca

    University of Tennessee at Knoxville, United States

    2 publications · 65 citations

    2

    h-index

  5. RK
    Rajkumar Kettimuthu

    Argonne National Laboratory, United States

    2 publications · 65 citations

    2

    h-index

1–5 of 32

Institutions

10

  1. Argonne National Laboratory

    Lemont, United States

    3 h-index

    6 publications

    156 citations

  2. University of Tennessee at Knoxville

    Knoxville, United States

    2 h-index

    8 publications

    260 citations

  3. The Ohio State University

    Columbus, United States

    2 h-index

    10 publications

    325 citations

  4. Oak Ridge National Laboratory

    Oak Ridge, United States

    2 h-index

    2 publications

    65 citations

  5. University of Manchester

    Manchester, United Kingdom

    2 h-index

    2 publications

    65 citations

  6. Ames National Laboratory

    Ames, United States

    1 h-index

    2 publications

    42 citations

  7. NEC (Japan)

    Tokyo, Japan

    1 h-index

    3 publications

    39 citations

  8. Purdue University West Lafayette

    West Lafayette, United States

    1 h-index

    3 publications

    42 citations

1–8 of 10

Venues

  1. Proceedings of the International Conference on Parallel Processing

    Conference · 1 publications · 16 citations

    1

    h-index

  2. 1

    h-index

  3. IBM Journal of Research and Development

    1 publications · 87 citations

    1

    h-index

1–3