Neural Computation · 1991 · 93 citations · 11 references
ComputingComputer ScienceArtificial IntelligenceComputer NetworksMachine LearningDeep LearningLetter RecognitionNeural NetworksPattern RecognitionRepresentation LearningWord RecognitionBackpropagationConnectionsHandwriting Letter RecognitionHandwriting RecognitionHandwritten Character RecognitionNetwork CapacityNeural Network-based RecognitionPrinted Character Recognition
We report on results of training backpropagation nets with samples of hand-printed digits scanned off of bank checks and hand-printed letters interactively entered into a computer through a stylus digitizer. Generalization results are reported as a function of training set size and network capacity. Given a large training set, and a net with sufficient capacity to achieve high performance on the training set, nets typically achieved error rates of 4-5% at a 0% reject rate and 1-2% at a 10% reject rate. The topology and capacity of the system, as measured by the number of connections in the net, have surprisingly little effect on generalization. For those developing hand-printed character recognition systems, these results suggest that a large and representative training sample may be the single, most important factor in achieving high recognition accuracy. Benefits of reducing the number of net connections, other than improving generalization, are discussed.
11
Backpropagation Applied to Handwritten Zip Code Recognition
Yann LeCun, Bernhard E. Boser, J. S. Denker et al. · Neural Computation · 1989 · 11.9K citations
Neural Networks and the Bias/Variance Dilemma
Stuart Geman, Elie Bienenstock, René Doursat · Neural Computation · 1992 · 3.6K citations
What Size Net Gives Valid Generalization?
Eric B. Baum, David Haussler · Neural Computation · 1989 · 1.6K citations
Generalization and network design strategies
Yann LeCun · 1989 · 844 citations