Applied Sciences · 2019 · 155 citations · 22 references
ComputingComputer ScienceData ScienceEducational Data MiningMachine LearningPredictive AnalyticsDecision TreesDropout PredictionEarly WarningEarly Warning SystemsEnsemble LearningEnsemble MethodsClass ImbalanceDropoutDropout Risk DetectionEnsemble-based PredictionImbalanced ClassificationReceiver Operating Characteristic AnalysisStudent Dropout PredictionSynthetic Minority Oversampling
A dropout early warning system helps schools identify at‑risk students, but class imbalance between dropout and non‑dropout cases hampers accurate prediction. The study aimed to improve dropout prediction by addressing class imbalance with SMOTE and ensemble methods and evaluating classifiers using ROC and PR curves. Using data from 165,715 South Korean high‑school students, the authors trained random forest, boosted decision tree, and their SMOTE‑augmented variants. ROC and PR analysis showed the boosted decision tree achieved the best performance.
A dropout early warning system enables schools to preemptively identify students who are at risk of dropping out of school, to promptly react to them, and eventually to help potential dropout students to continue their learning for a better future. However, the inherent class imbalance between dropout and non-dropout students could pose difficulty in building accurate predictive modeling for a dropout early warning system. The present study aimed to improve the performance of a dropout early warning system: (a) by addressing the class imbalance issue using the synthetic minority oversampling techniques (SMOTE) and the ensemble methods in machine learning; and (b) by evaluating the trained classifiers with both receiver operating characteristic (ROC) and precision–recall (PR) curves. To that end, we trained random forest, boosted decision tree, random forest with SMOTE, and boosted decision tree with SMOTE using the big data samples of the 165,715 high school students from the National Education Information System (NEIS) in South Korea. According to our ROC and PR curve analysis, boosted decision tree showed the optimal performance.
22
SMOTE: Synthetic Minority Over-sampling Technique
Nitesh V. Chawla, Kevin W. Bowyer, Lawrence Hall et al. · Journal of Artificial Intelligence Research · 2002 · 31.2K citations · Full text
An introduction to ROC analysis
Tom Fawcett · Pattern Recognition Letters · 2005 · 21.3K citations
Rapid object detection using a boosted cascade of simple features
Paul Viola, Michael Jones · 2005 · 18.2K citations