IEEE Transactions on Neural Networks · 1995 · 56 citations · 5 references
ComputingComputer ScienceArtificial IntelligenceMachine LearningOptimizationGradient-based OptimizationLearning In Neural SystemsNeural NetworksOptimization For Machine LearningPattern RecognitionRepresentation LearningFeedforward Neural NetworksGradient DescentMultilayer NetworksMultilayer PerceptronNeural Network ModelingOptimization Algorithms
Gradient descent learning algorithms may get stuck in local minima, thus making the learning suboptimal. In this paper, we focus attention on multilayered networks used as autoassociators and show some relationships with classical linear autoassociators. In addition, by using the theoretical framework of our previous research, we derive a condition which is met at the end of the learning process and show that this condition has a very intriguing geometrical meaning in the pattern space.
5
Local minima and back propagation
Timothy Poston, C.-N. Lee, YoungJu Choie et al. · 2002 · 35 citations