Neural Computation · 1991 · 36 citations · 4 references
ComputingComputer ScienceAlgorithmsArtificial IntelligenceMachine LearningDeep LearningHint GenerationNeural NetworksOptimization For Machine LearningPattern RecognitionRepresentation LearningHamming DistanceMinimum DistanceOptimal Decision MakingPerceptronSolution Space Exploration
The aim of a neural net is to partition the data space into near optimal decision regions. Learning such a partitioning solely from examples has proven to be a very hard problem (Blum and Rivest 1988; Judd 1988). To remedy this, we use the idea of supplying hints to the network-as discussed by Abu-Mostafa (1990). Hints reduce the solution space, and as a consequence speed up the learning process. The minimum Hamming distance between the patterns serves as the hint. Next, it is shown how to learn such a hint and how to incorporate it into the learning algorithm. Modifications in the net structure and its operation are suggested, which allow for a better generalization. The sensitivity to errors in such a hint is studied through some simulations.
4
Learning from hints in neural networks
Yaser S. Abu‐Mostafa · Journal of Complexity · 1990 · 243 citations
On the complexity of loading shallow neural networks
Stephen Judd · Journal of Complexity · 1988 · 188 citations
Yaser S. Abu‐Mostafa · Neural Computation · 1993 · 81 citations · Full text