Concepedia

Dynamic Sparse Training

Dynamic Sparse Training is a machine learning methodology that iteratively prunes and repurposes network weights during training to maintain sparsity without compromising model performance, distinguished by its adaptive reallocation of connectivity in contrast to static sparse training approaches.

30

Publications

1.4K

Citations

118

Authors

39

Institutions

Publications per year

2017–2026

28

Parents

Publications

30

Dynamic Slimmable Network

Changlin Li, Guangrun Wang, Bing Wang et al. · 2021 · 137 citations

, , +14

Semi-supervised fault classification based on dynamic Sparse Stacked auto-encoders model

Li Jiang, Zhiqiang Ge, Zhihuan Song · Chemometrics and Intelligent Laboratory Systems · 2017 · 123 citations

, , +13

Parameter Efficient Training of Deep Convolutional Neural Networks by Dynamic Sparse Reparameterization

Hesham Mostafa, Xin Wang · arXiv (Cornell University) · 2019 · 123 citations · Full text

, , +16

ViTCoD: Vision Transformer Acceleration via Dedicated Algorithm and Accelerator Co-Design

Haoran You, Zhanyi Sun, Huihong Shi et al. · 2023 · 112 citations

, , +15

Federated Dynamic Sparse Training: Computing Less, Communicating Less, Yet Learning Better

Sameer Bibikar, Haris Vikalo, Zhangyang Wang et al. · Proceedings of the AAAI Conference on Artificial Intelligence · 2022 · 92 citations · Full text

, , +15

1–5 of 30

Authors

118

  1. DC
    Decebal Constantin Mocanu

    Eindhoven University of Technology, Netherlands

    6 publications · 123 citations

    6

    h-index

  2. MP
    Mykola Pechenizkiy

    Eindhoven University of Technology, Netherlands

    6 publications · 123 citations

    6

    h-index

  3. EM
    Elena Mocanu

    Eindhoven University of Technology, Netherlands

    3 publications · 50 citations

    3

    h-index

  4. SL
    Shiwei Liu

    Huazhong University of Science and Technology, China

    2 publications · 25 citations

    2

    h-index

  5. SU
    Sebastian U. Stich

    École Polytechnique Fédérale de Lausanne, Switzerland

    2 publications · 102 citations

    2

    h-index

1–5 of 118

Institutions

39

  1. University of Twente

    Enschede, The Netherlands

    3 h-index

    5 publications

    136 citations

  2. Eindhoven University of Technology

    Eindhoven, The Netherlands

    3 h-index

    11 publications

    328 citations

  3. University of Illinois Urbana-Champaign

    Urbana, United States

    2 h-index

    6 publications

    230 citations

  4. Tsinghua University

    Beijing, China

    2 h-index

    13 publications

    306 citations

  5. The University of Texas at Austin

    Austin, United States

    2 h-index

    5 publications

    393 citations

  6. Google (United States)

    Mountain View, United States

    2 h-index

    7 publications

    249 citations

  7. University of California San Diego

    San Diego, United States

    2 h-index

    2 publications

    153 citations

  8. Meta (Israel)

    Tel Aviv, Israel

    1 h-index

    1 publications

    37 citations

1–8 of 39

Venues

  1. arXiv (Cornell University)

    Repository · 9 publications · 395 citations

    9

    h-index

  2. Proceedings of the AAAI Conference on Artificial Intelligence

    Conference · 2 publications · 129 citations

    2

    h-index

  3. Applied Soft Computing

    1 publications · 13 citations

    1

    h-index

  4. 1

    h-index

  5. 1

    h-index

1–5