Optimization Algorithms
Optimization Algorithm is a computational procedure within numerical algorithms that systematically iteratively adjusts model parameters in deep learning to minimize or maximize a given objective function by leveraging gradient-based or gradient-free strategies.
10.3K
Publications
803.7K
Citations
27.3K
Authors
4.5K
Institutions
Publications per year
2017–2026
6.5K
Variants
Optimization Algorithm
10.3K
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
A Limited Memory Algorithm for Bound Constrained Optimization
Richard H. Byrd, Peihuang Lu, Jorge Nocedal et al. · SIAM Journal on Scientific Computing · 1995 · 6.2K citations
1–5 of 10.3K
27.3K
30
h-index
29
h-index
26
h-index
23
h-index
National Institute for Research and Development in Informatics - ICI Bucharest, Romania
22 publications · 1.8K citations
21
h-index
1–5 of 27.3K
4.5K
University of California, Berkeley
Berkeley, United States
60 h-index
259 publications
30.8K citations
Massachusetts Institute of Technology
Cambridge, United States
56 h-index
241 publications
27.1K citations
Google (United States)
Mountain View, United States
55 h-index
357 publications
38.4K citations
Stanford University
Stanford, United States
52 h-index
227 publications
23.7K citations
Carnegie Mellon University
Pittsburgh, United States
47 h-index
208 publications
22.6K citations

University of Toronto
Toronto, Canada
44 h-index
189 publications
116.5K citations
Princeton University
Princeton, United States
43 h-index
154 publications
10.3K citations
Tsinghua University
Beijing, China
42 h-index
312 publications
17.3K citations
1–8 of 4.5K
Repository · 1.3K publications · 113.6K citations
140
h-index
277 publications · 17.3K citations
64
h-index
109 publications · 6.2K citations
48
h-index
83 publications · 9.3K citations
47
h-index
58 publications · 25.3K citations
40
h-index
1–5