2022 · 43 citations · 19 references
ComputingData ScienceMachine LearningStatistical LearningStatistical ModelingBattery TestingEnsemble LearningEnsemble MethodsOverfittingPredictive ModelingUnderfittingBaggingBenchmark DatasetsLinear ModelsLinear RegressionMachine Learning Prediction ModelsMultiple RegressionRandom ForestsRegression Trees
Battery performance datasets are typically non-normal and multicollinear. Extrapolating such datasets for model predictions needs attention to such characteristics. This study explores the impact of data normality in building machine learning models. In this work, tree-based regression models and multiple linear regressions models are each built from a highly skewed non-normal dataset with multicollinearity and compared. Several techniques are necessary, such as data transformation, to achieve a good multiple linear regression model with this dataset; the most useful techniques are discussed. With these techniques, the best multiple linear regression model achieved an $R^{2} = 81. 23\%$ and exhibited no multicollinearity effect for the dataset used in this study. Tree-based models perform better on this dataset, as they are non-parametric, capable of handling complex relationships among variables and not affected by multicollinearity. We show that bagging, in the use of Random Forests, reduces overfitting. Our best tree-based model achieved accuracy of $R^{2} =97.73\%$. This study explains why tree-based regressions promise as a machine learning model for non-normally distributed, multicollinear data.
19
Leo Breiman · Machine Learning · 2001 · 126.2K citations · Full text
Classification and Regression Trees.
Alexander Gordon, Leo Breiman, Jerome H. Friedman et al. · Biometrics · 1984 · 23.9K citations
RANDOM FORESTS FOR CLASSIFICATION IN ECOLOGY
D. Richard Cutler, Thomas C. Edwards, Karen H. Beard et al. · Ecology · 2007 · 4.8K citations
Data-driven prediction of battery cycle life before capacity degradation
Kristen Severson, Peter M. Attia, Norman Jin et al. · Nature Energy · 2019 · 2.9K citations · Full text