2003 · 191 citations · 2 references
Artificial IntelligenceSearch OptimizationEngineeringMachine LearningNeural Networks (Machine Learning)Meta-learningRecurrent Neural NetworkSocial SciencesPattern RecognitionSparse Neural NetworkEnhanced Neural NetworkCognitive ScienceComputational Learning TheoryMeta-neural NetworkMachine Learning ModelNeural Networks (Computational Neuroscience)Computer ScienceBasic Neural NetworkDeep LearningDeep Neural NetworksMeta-learning (Computer Science)Meta-neural Networks
A novel method for training neural networks is introduced. The method uses an additional observing neural network called a meta-neural network (MNN) to direct the training of the basic neural network. The MNN provides the basic neural network with a step size and a direction vector which is optimal based on successful training strategies learned from problems solved previously. The combination of the MNN with the basic neural network is shown to improve learning rates for several problems when the MNN is trained on a similar problem. The MNN is shown to help solve the problem of sensitivity to initial weight vectors. In addition, computer simulations demonstrate the improvement in the learning rate of the enhanced neural network on a 4-b parity problem, when it has been trained on a different nonlinear Boolean function.< <ETX xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">></ETX>
2
The formation of learning sets.
Harry F. Harlow · Psychological Review · 1949 · 2K citations
Direct transfer of learned information among neural networks
Lorien Pratt, Jack Mostow, Candace Kamm · 1991 · 148 citations