Can backpropagation error surface not have local minima

Xiao-Hu Yu

IEEE Transactions on Neural Networks · 1992 · 109 citations · 13 references

Concepts

Abstract

It is shown theoretically that for an arbitrary T-element training set with t(t=/<T) different inputs, the backpropagation error surface does not have suboptimal local minima if the network is capable of exactly implementing an arbitrary training set consisting of t different patterns. As a special case, the error surface of a backpropagation network with one hidden layer and t-1 hidden units has no local minima, if the network is trained by an arbitrary T-element set with t different inputs.

References

13