Children and Youth Services Review · 2021 · 12 citations · 16 references
EducationChild HealthPediatricsAutism Spectrum DisordersBehavioral HealthHealth Services ResearchBehavioral Intervention EvaluationCommunity-based RehabilitationHealth Services EvaluationHealth Status MeasurementStrengths AssessmentBehavioral Health AssessmentChild Outcomes MonitoringCommunity Health Program MonitoringCommunity Health Service EvaluationGradient BoostingIntelligent Decision Support SystemsMachine Learning For HealthcarePublic Health Program Evaluation
The CANS is the most popular measurement tool in the System of Care (SoC), with the potential to generate an estimated 1.9 million evaluations per year in the United States. This dataset has broad potential for decision support and outcomes monitoring, yet many SoC services do not yet leverage this information asset. We report here the results of a pilot project in which we applied machine learning methods to CANS data for the purpose of identifying clinical profiles associated with improvement in a public community-based behavioral health program in Pennsylvania. We analyzed over 7,000 CANS from 3,385 children who participated in Pennsylvania’s Medicaid-funded behavioral health rehabilitation services (BHRS) program during 2013–2019. A gradient boosting classifier was developed to identify children most likely to experience a total score improvement on the CANS while participating in BHRS. Separate models were constructed for children with and without autism spectrum disorder (ASD). CANS-based clinical profiles associated with improvement were also identified. Analyses were run using Python Sci-Ki version 0.20.3 and Linearly Interpretable Model-agnostic Explanations (LIME) version 0.1.1.33. The mean age of BHRS participants was 9.85 years (standard deviation: 3.47) and the majority were white (54%) or African American (11.5%). The median length of stay was 963 days (range: 541–2,008) and 39% (N = 1,330) had a diagnosis of ASD. A total of 49.9% of children had a CANS total score improvement. Precision of the gradient boosting classifier was 70% and 79% for children with and without ASD, respectively. Fourteen profiles were associated with improvement in ASD (mean probability of improvement per profile = 0.95, range: 0.88–1.0) and 55 such profiles were identified in children without ASD (mean probability of improvement: 0.91, range: 0.86–1.0). Machine learning can be applied to the CANS to identify children who have high probability of improvement in BHRS. These methods may have utility as an adjunct to existing decision support systems for SoC services.
16
The relationship between Precision-Recall and ROC curves
Jesse Davis, Mark Goadrich · 2006 · 6.3K citations · Full text
Dissecting racial bias in an algorithm used to manage the health of populations
Ziad Obermeyer, Brian W. Powers, Christine Vogeli et al. · Science · 2019 · 6.1K citations · Full text
Public Health, Health Care Management, Health Informatics +17