Journal of Education for Students Placed at Risk (JESPAR) · 2019 · 231 citations · 65 references
EducationEducational AssessmentEducational MeasurementDiagnostic AssessmentEarly DetectionPredictive AnalyticsDiagnostic EvaluationDiagnostic Test EvaluationDropout PredictionEarly WarningEarly Warning SystemsRisk PredictionAccuracy AnalysisClassification Accuracy AnalysisDetection TheoryEarly Warning Systems EducationOperating Characteristic CurvesPredictive Modeling In EducationReceiver Operating Characteristic AnalysisStudent Dropout Prediction
Early Warning Systems (EWS) and Early Warning Indictors (EWI) have recently emerged as an attractive domain for states and school districts interested in predicting student outcomes using data that schools already collect with the intention to better time and tailor interventions. However, current diagnostic measures used across the domain do not consider the dual issues of sensitivity and specificity of predictors, key components for considering accuracy. We apply signal detection theory using Receiver Operating Characteristic (ROC) Area Under the Curve (AUC) analysis adapted from the engineering and medical domains, and using the pROC package in R. Using nationally generalizable data from the Education Longitudinal Study of 2002 (ELS:2002) we provide examples of applying ROC accuracy analysis to a variety of predictors of student outcomes, such as dropping out of high school, college enrollment, and postsecondary STEM degrees and careers.
65
R: A Language and Environment for Statistical Computing
R Core Team · 2000 · 353K citations · Full text
Natural Sciences, Computer Science, Statistical Computing +10
pROC: an open-source package for R and S+ to analyze and compare ROC curves
Xavier Robin, Natacha Turck, Alexandre Hainard et al. · BMC Bioinformatics · 2011 · 14K citations · Full text