Neighborhood based modified backpropagation algorithm using adaptive learning parameters for training feedforward neural networks

An Algorithm for Least-Squares Estimation of Nonlinear Parameters

Donald W. Marquardt · Journal of the Society for Industrial and Applied Mathematics · 1963 · 30.1K citations

Parameter Estimation, Engineering, Nonlinear Optimization +17

A method for the solution of certain non-linear problems in least squares

Kenneth Levenberg · Quarterly of Applied Mathematics · 1944 · 12K citations · Full text

Numerical Analysis, Mathematical Programming, Engineering +9

Training feedforward networks with the Marquardt algorithm

Martin Hagan, Mohammad Bagher Menhaj · IEEE Transactions on Neural Networks · 1994 · 7.6K citations

Nonlinear System Identification, Conjugate Gradient Algorithm, Engineering +10

A direct adaptive method for faster backpropagation learning: the RPROP algorithm

Martin Riedmiller, Heinrich Braun · IEEE International Conference on Neural Networks · 2002 · 3.9K citations

Artificial Intelligence, Incremental Learning, Engineering +20

Parallel & distributed processing

Philipp Slusallek, Peter Shirley, William R. Mark et al. · 2005 · 2.6K citations

Engineering, Computer Architecture, Distributed Data Processing +17