2008 · 75 citations · 7 references
ComputingBiostatisticsComputer ScienceMachine LearningPredictive AnalyticsStatistical ModelingDecision TreesEnsemble MethodsAdditive Interaction ModelingEnsemble RegressionInteraction DetectionInteraction Pattern DetectionMultivariable Prediction ModelsPrediction ModelsRegression-based Interaction Analysis
Discovering additive structure is an important step towards understanding a complex multi-dimensional function because it allows the function to be expressed as the sum of lower-dimensional components. When variables interact, however, their effects are not additive and must be modeled and interpreted simultaneously. We present a new approach for the problem of interaction detection. Our method is based on comparing the performance of unrestricted and restricted prediction models, where restricted models are prevented from modeling an interaction in question. We show that an additive model-based regression ensemble, Additive Groves, can be restricted appropriately for use with this framework, and thus has the right properties for accurately detecting variable interactions.
7
Greedy function approximation: A gradient boosting machine.
Jerome H. Friedman · The Annals of Statistics · 2001 · 29K citations · Full text
Predictive learning via rule ensembles
Jerome H. Friedman, Bogdan Popescu · The Annals of Applied Statistics · 2008 · 1.3K citations · Full text
Sparse spatial autoregressions
R. Kelley Pace, Ronald P. Barry · Statistics & Probability Letters · 1997 · 496 citations
Testing the significance of attribute interactions
Aleks Jakulin, Ivan Bratko · 2004 · 134 citations · Full text