Increased rates of convergence through learning rate adaptation

Adaptive filter theory

Maurice Bellanger · Signal Processing · 1987 · 3K citations

Learning Quickly When Irrelevant Attributes Abound: A New Linear-Threshold Algorithm

Nick Littlestone · Machine Learning · 1988 · 1.4K citations

Computing, Computer Science, Algorithms +6

Accelerated Stochastic Approximation

Harry Kesten · The Annals of Mathematical Statistics · 1958 · 438 citations · Full text

Natural Sciences, Computer Science, Mathematics +12

Adaptive filters: Structures, algorithms, and applications

B. Dickinson · IEEE Transactions on Acoustics Speech and Signal Processing · 1985 · 288 citations

Engineering, Computer Science, Information Theory +9

Two problems with backpropagation and other steepest-descent learning procedures for networks

Richard S. Sutton · eScholarship (California Digital Library) · 1986 · 185 citations

Computing, Computer Science, Algorithms +7