Concepedia

Learning Rate Scheduling

Learning Rate Scheduling is a gradient-based optimization technique that systematically adjusts the learning rate hyperparameter during training according to a predefined rule or policy to improve convergence and model performance.

82

Publications

5.7K

Citations

269

Authors

68

Institutions

Publications per year

2017–2026

68

Variants

Learning Rate Schedules

Parents

Publications

82

Breast cancer histopathological image classification using convolutional neural networks with small SE-ResNet module

Yun Jiang, Li Chen, Hai Zhang et al. · PLoS ONE · 2019 · 364 citations · Full text

, , +17

Competence-based Curriculum Learning for Neural Machine Translation

Emmanouil Antonios Platanios, Otilia Stretcu, Graham Neubig et al. · 2019 · 308 citations · Full text

, , +13

Extremely Large Minibatch SGD: Training ResNet-50 on ImageNet in 15 Minutes

Takuya Akiba, Shuji Suzuki, Keisuke Fukuda · arXiv (Cornell University) · 2017 · 282 citations · Full text

, , +17

Three Factors Influencing Minima in SGD

Stanisław Jastrzȩbski, Zachary Kenton, Devansh Arpit et al. · arXiv (Cornell University) · 2017 · 251 citations · Full text

, , +12

Efficient online sphercal K-means clustering

Shi Zhong · Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005. · 2006 · 220 citations

, , +17

1–5 of 82

Authors

269

  1. JM
    John Moody

    Yale University, United States

    4 publications · 606 citations

    4

    h-index

  2. TR
    Tapani Raiko

    Aalto University, Finland

    3 publications · 270 citations

    3

    h-index

  3. LG
    Liang Gao

    Huazhong University of Science and Technology, China

    3 publications · 244 citations

    3

    h-index

  4. XL
    Xinyu Li

    Huazhong University of Science and Technology, China

    3 publications · 244 citations

    3

    h-index

  5. AG
    Andrew Gordon Wilson

    Cornell University, United States

    3 publications · 260 citations

    3

    h-index

1–5 of 269

Institutions

68

  1. Huazhong University of Science and Technology

    Wuhan, China

    5 h-index

    13 publications

    708 citations

  2. Carnegie Mellon University

    Pittsburgh, United States

    5 h-index

    12 publications

    510 citations

  3. Google (United States)

    Mountain View, United States

    5 h-index

    38 publications

    6.5K citations

  4. Yale University

    New Haven, United States

    4 h-index

    9 publications

    1.4K citations

  5. Cornell University

    Ithaca, United States

    4 h-index

    13 publications

    938 citations

  6. Aalto University

    Espoo, Finland

    3 h-index

    9 publications

    810 citations

  7. University of Oxford

    Oxford, United Kingdom

    3 h-index

    10 publications

    189 citations

  8. Microsoft Research (United Kingdom)

    Cambridge, United Kingdom

    3 h-index

    8 publications

    540 citations

1–8 of 68

Venues

  1. arXiv (Cornell University)

    Repository · 31 publications · 1.9K citations

    18

    h-index

  2. IEEE Access

    4 publications · 120 citations

    4

    h-index

  3. Scientific Reports

    2 publications · 56 citations

    2

    h-index

  4. Neural Information Processing Systems

    Conference · 2 publications · 229 citations

    2

    h-index

  5. Frontiers in Plant Science

    1 publications · 52 citations

    1

    h-index

1–5