Concepedia

Batch Size Scaling

Batch Size Scaling is a methodological approach in deep learning optimization that systematically adjusts the batch size during training to improve convergence efficiency and generalization performance.

71

Publications

6K

Citations

253

Authors

56

Institutions

Publications per year

2017–2026

61

Parents

Publications

71

Sigmoid Loss for Language Image Pre-Training

Xiaohua Zhai, Basil Mustafa, Lucas Beyer · 2023 · 634 citations

, , +10

Large Batch Training of Convolutional Networks

Yang You, Igor Gitman, Boris Ginsburg · arXiv (Cornell University) · 2017 · 509 citations · Full text

, , +17

Deep Learning is Robust to Massive Label Noise

David Rolnick, Andreas Veit, Serge Belongie et al. · arXiv (Cornell University) · 2017 · 410 citations · Full text

, , +15

ImageNet Training in Minutes

Yang You, Zhao Zhang, Cho‐Jui Hsieh et al. · 2018 · 408 citations

, , +15

Don't Decay the Learning Rate, Increase the Batch Size

Samuel Smith, Pieter-Jan Kindermans, Chris Ying et al. · arXiv (Cornell University) · 2017 · 394 citations · Full text

, , +15

1–5 of 71

Authors

253

  1. YY
    Yang You

    National University of Singapore, Singapore

    12 publications · 1.5K citations

    12

    h-index

  2. KK
    Kurt Keutzer

    University of California, Berkeley, United States

    8 publications · 712 citations

    8

    h-index

  3. CH
    Cho‐Jui Hsieh

    University of California, Los Angeles, United States

    7 publications · 701 citations

    7

    h-index

  4. SS
    Samuel Smith

    Sinai Hospital, United States

    6 publications · 789 citations

    6

    h-index

  5. JD
    James Demmel

    University of California, Berkeley, United States

    6 publications · 640 citations

    6

    h-index

1–5 of 253

Institutions

56

  1. Google (United States)

    Mountain View, United States

    11 h-index

    34 publications

    2.9K citations

  2. University of California, Berkeley

    Berkeley, United States

    9 h-index

    26 publications

    2.4K citations

  3. Berkeley College

    New York, United States

    4 h-index

    13 publications

    1.8K citations

  4. Carnegie Mellon University

    Pittsburgh, United States

    3 h-index

    5 publications

    283 citations

  5. National University of Singapore

    Singapore, Singapore

    3 h-index

    10 publications

    352 citations

  6. Texas A&M University

    College Station, United States

    3 h-index

    10 publications

    186 citations

  7. University of California, Davis

    Davis, United States

    2 h-index

    2 publications

    453 citations

  8. Harvard University

    Cambridge, United States

    2 h-index

    6 publications

    1.9K citations

1–8 of 56

Venues

  1. arXiv (Cornell University)

    Repository · 28 publications · 2.6K citations

    18

    h-index

  2. Proceedings of the AAAI Conference on Artificial Intelligence

    Conference · 2 publications · 28 citations

    2

    h-index

  3. ACM Proceedings

    1 publications · 25 citations

    1

    h-index

  4. International Journal of Pharmaceutics

    1 publications · 37 citations

    1

    h-index

  5. KONA Powder and Particle Journal

    1 publications · 341 citations

    1

    h-index

1–5