Optimizing the optimizer for physics-informed neural networks and Kolmogorov-Arnold networks

Deterministic Nonperiodic Flow

Edward N. Lorenz · Journal of the Atmospheric Sciences · 1963 · 19.3K citations · Full text

Natural Sciences, Mathematics, Physics +12

A Stochastic Approximation Method

Herbert Robbins, Sutton Monro · The Annals of Mathematical Statistics · 1951 · 9.6K citations · Full text

Computing, Computer Science, Algorithms +9

On the limited memory BFGS method for large scale optimization

Jorge Nocedal · Mathematical Programming · 1989 · 8.5K citations

Computing, Computer Engineering, Computer Science +12

A new approach to variable metric algorithms

R. Fletcher · The Computer Journal · 1970 · 4.1K citations · Full text

Computing, Computer Science, Algorithms +10

Conditioning of quasi-Newton methods for function minimization

David F. Shanno · Mathematics of Computation · 1970 · 3.7K citations · Full text

Computing, Computer Science, Mathematics +13