Concepedia

Soft Parameter Sharing

Soft Parameter Sharing is a multi-task learning strategy in which task-specific models are connected through a probabilistic or regularized coupling of their parameters, allowing for flexible parameter divergence while encouraging similarity via auxiliary loss terms or prior distributions, in contrast to hard parameter sharing that enforces identical parameters across tasks.

30

Publications

1.2K

Citations

114

Authors

48

Institutions

Publications per year

2017–2026

28

Parents

Publications

30

Learning Sparse Sharing Architectures for Multiple Tasks

Tianxiang Sun, Yunfan Shao, Xiaonan Li et al. · Proceedings of the AAAI Conference on Artificial Intelligence · 2020 · 136 citations · Full text

, , +11

Shared logistic normal distributions for soft parameter tying in unsupervised grammar induction

Shay B. Cohen, Noah A. Smith · 2009 · 124 citations · Full text

, , +15

Sluice networks: Learning what to share between loosely related tasks.

Sebastian Ruder, Joachim Bingel, Isabelle Augenstein et al. · arXiv (Cornell University) · 2017 · 118 citations · Full text

, , +14

SNR: Sub-Network Routing for Flexible Parameter Sharing in Multi-Task Learning

Jiaqi Ma, Zhe Zhao, Jilin Chen et al. · Proceedings of the AAAI Conference on Artificial Intelligence · 2019 · 117 citations · Full text

, , +15

An Improved Event-Independent Network for Polyphonic Sound Event Localization and Detection

Yin Cao, Turab Iqbal, Qiuqiang Kong et al. · 2021 · 74 citations

, , +16

1–5 of 30

Authors

114

  1. IA
    Isabelle Augenstein

    University of Copenhagen, Denmark

    2 publications · 186 citations

    2

    h-index

  2. TS
    Tianxiang Sun

    Fudan University, China

    2 publications · 153 citations

    2

    h-index

  3. AS
    Anders Søgaard

    University of Copenhagen, Denmark

    2 publications · 186 citations

    2

    h-index

  4. NA
    Noah A. Smith

    Carnegie Mellon University, United States

    2 publications · 152 citations

    2

    h-index

  5. XQ
    Xipeng Qiu

    Fudan University, China

    2 publications · 153 citations

    2

    h-index

1–5 of 114

Institutions

48

  1. Google DeepMind (United Kingdom)

    London, United Kingdom

    2 h-index

    2 publications

    135 citations

  2. Tsinghua University

    Beijing, China

    2 h-index

    5 publications

    203 citations

  3. Carnegie Mellon University

    Pittsburgh, United States

    2 h-index

    3 publications

    276 citations

  4. Fudan University

    Shanghai, China

    2 h-index

    12 publications

    918 citations

  5. Google (United States)

    Mountain View, United States

    2 h-index

    6 publications

    603 citations

  6. Xidian University

    Xi'an, China

    2 h-index

    2 publications

    153 citations

  7. Tianjin University

    Tianjin, China

    2 h-index

    3 publications

    121 citations

  8. Ruijin Hospital

    Shanghai, China

    1 h-index

    1 publications

    31 citations

1–8 of 48

Venues

  1. arXiv (Cornell University)

    Repository · 4 publications · 204 citations

    4

    h-index

  2. Proceedings of the AAAI Conference on Artificial Intelligence

    Conference · 2 publications · 253 citations

    2

    h-index

  3. 2

    h-index

  4. Methods

    1 publications · 31 citations

    1

    h-index

  5. IEEE Transactions on Mobile Computing

    TMCCI · 1 publications · 67 citations

    1

    h-index

1–5