1992 · 81 citations · 9 references
ComputingComputer ScienceKnowledge ArchitectureKnowledge RepresentationMachine LearningExpert SystemsKnowledge Base DesignKnowledge StructuringNetwork StructureNeural NetworksRule-based RepresentationBasis FunctionsComplexityKnowledge Base ArchitectureNeural Network ModelingRule ExtractionRule LearningRule MiningRule-based Knowledge Representation
We demonstrate in this paper how certain forms of rule-based knowledge can be used to prestructure a neural network of normalized basis functions and give a probabilistic interpretation of the network architecture. We describe several ways to assure that rule-based knowledge is preserved during training and present a method for complexity reduction that tries to minimize the number of rules and the number of conjuncts. After training, the refined rules are extracted and analyzed. Mail address: Siemens AG, Central Research, Otto-Hahn-Ring 6, 8000 Munchen 83. 1 INTRODUCTION Training a network to model a high dimensional input/output mapping with only a small amount of training data is only possible if the underlying map is of low complexity: a more complex mapping requires a more complex network which results in high parameter variances and, as a consequence, in a high prediction error. This predicament can be solved if we manage to incorporate prior knowledge to bias the network as...
9
Classification and Regression Trees.
Alexander Gordon, Leo Breiman, Jerome H. Friedman et al. · Biometrics · 1984 · 23.9K citations
Adaptive Mixtures of Local Experts
Robert A. Jacobs, Michael I. Jordan, Steven J. Nowlan et al. · Neural Computation · 1991 · 5K citations
Donald F. Specht · Neural Networks · 1990 · 3.8K citations