Urban Water Journal · 2018 · 10 citations · 12 references
ComputingComputer ScienceHydrologyFeature EngineeringMachine LearningPredictive AnalyticsDecision TreesEnsemble MethodsFeature SelectionPredictive MaintenanceSewerage EngineeringVariable SelectionFailure PredictionMutual Information AnalysisRandom Forest ClassificationSelection AlgorithmsSewer Failure AnalysisSewer MaintenanceStatistical Model SelectionStepwise Regression
When defining the variables to predict sewer failure and therefore optimise sewer systems maintenance, it is important to identify the ones that most significantly influence the quality of the predictions or to define the smallest number of variables that is sufficient to obtain accurate predictions. In this study, three different statistical variable selection algorithms are applied for the first time to identify the most important variables for sewer failure prediction: the mutual information indicator, the out-of-bag samples concept, based on the random forest algorithm, and the stepwise search approach. The methods were applied to a real data-set that consists of the categorisation of sewer condition and associated physical characteristics. The mutual information and the stepwise search methods provided good predictions while those obtained using out-of-bag samples based on random forest were somewhat different, justified by the lack of robustness to imbalanced class distributions.
12
R: A Language and Environment for Statistical Computing
R Core Team · 2000 · 353K citations · Full text
Natural Sciences, Computer Science, Statistical Computing +10
Leo Breiman · Machine Learning · 2001 · 126.2K citations · Full text
Classification and Regression Trees.
Alexander Gordon, Leo Breiman, Jerome H. Friedman et al. · Biometrics · 1984 · 23.9K citations
Bias reduction of maximum likelihood estimates
David Firth · Biometrika · 1993 · 4.4K citations
Alexander Kraskov, Harald Stögbauer, Peter Grassberger · Physical Review E · 2004 · 4.1K citations · Full text