Neural Computation · 1991 · 43 citations · 29 references
ComputingComputer ScienceMathematicsAlgorithmsMachine LearningTheory Of ComputationApproximation AlgorithmsNeural NetworksNumerical AlgorithmsReduced-order ModelingData-driven Model ReductionDelay Differential Equation ModelsK-d TreesLearningNetwork ApproximationTree AlgorithmsVariable-size Representation
I describe a new algorithm for approximating continuous functions in high-dimensional input spaces. The algorithm builds a tree-structured network of variable size, which is determined both by the distribution of the input data and by the function to be approximated. Unlike other tree-structured algorithms, learning occurs through completely local mechanisms and the weights and structure are modified incrementally as data arrives. Efficient computation in the tree structure takes advantage of the potential for low-order dependencies between the output and the individual dimensions of the input. This algorithm is related to the ideas behind k-d trees (Bentley 1975), CART (Breiman et al. 1984), and MARS (Friedman 1988). I present an example that predicts future values of the Mackey-Glass differential delay equation.
29
Classification and Regression Trees.
Alexander Gordon, Leo Breiman, Jerome H. Friedman et al. · Biometrics · 1984 · 23.9K citations
Classification and Regression Trees.
John Van Ryzin, Leo Breiman, Jerome H. Friedman et al. · Journal of the American Statistical Association · 1986 · 21K citations
Multivariate Adaptive Regression Splines
Jerome H. Friedman · The Annals of Statistics · 1991 · 8.1K citations · Full text
Multidimensional binary search trees used for associative searching
Jon Bentley · Communications of the ACM · 1975 · 7.5K citations · Full text