Applied Sciences · 2021 · 49 citations · 42 references
ComputingData ScienceData MiningMachine LearningPredictive AnalyticsClassificationDecision TreesEnsemble LearningEnsemble MethodsFeature SelectionVariable SelectionExtreme Gradient BoostingFeature ImportanceFeature Selection In TreesGradient BoostingGradient Boosting TreesPredictive PerformancePredictive Performance EvaluationTree-based Variable Importance
This study aimed to identify the strongest predictive variables of winning and losing in the highest Belgian soccer division. A predictive machine learning model based on a broad range of variables (n = 100) was constructed, using a dataset consisting of 576 games. To avoid multicollinearity and reduce dimensionality, Variance Inflation Factor (threshold of 5) and BorutaShap were respectively applied. A total of 13 variables remained and were used to predict winning or losing using Extreme Gradient Boosting. TreeExplainer was applied to determine feature importance on a global and local level. The model showed an accuracy of 89.6% ± 3.1% (precision: 88.9%; recall: 90.1%, f1-score: 89.5%), correctly classifying 516 out of 576 games. Shots on target from the attacking penalty box showed to be the best predictor. Several physical indicators are amongst the best predictors, as well as contextual variables such as ELO -ratings, added transfers value of the benched players and match location. The results show the added value of the inclusion of a broad spectrum of variables when predicting and evaluating game outcomes. Similar modelling approaches can be used by clubs to identify the strongest predictive variables for their leagues, and evaluate and improve their current quantitative analyses.
42
From local explanations to global understanding with explainable AI for trees
Scott Lundberg, Gabriel Erion, Hugh Chen et al. · Nature Machine Intelligence · 2020 · 8.9K citations · Full text
Statistics versus machine learning
Danilo Bzdok, Naomi Altman, Martin Krzywinski · Nature Methods · 2018 · 1.5K citations · Full text