2023 · 10 citations · 9 references
EducationComputer ScienceEducational MeasurementPerformance AssessmentPerformance MeasurementSoftware EngineeringEducational Software EvaluationProject Performance MeasurementSoftware DesignSoftware MetricsStudent Achievement AnalysisStudent Success AnalyticsObject-oriented ArchitectureSelf-administered QuestionnairesSelf-report QuestionnairesSoftware Project MetricsSource Code MetricsStatistical Significance TestingStudent Performance Data AnalysisStudent Performance Reporting
What skills does a student need to succeed in a programming class? Ostensibly, previous programming experience may affect a student's performance. Most past studies on this topic use self-reporting questionnaires to query students about their programming experience. This paper presents a novel, unified, and replicable way to measure previous programming experience using students' pre-class GitHub contributions. To our knowledge, we are the first to use GitHub contributions in this way. We conducted a comprehensive statistical study of students in an object-oriented design and development class from 2017 to 2022 (n = 751) to explore the relationships between GitHub contributions (commits, comments, pull requests, etc.) and students' performance on exams, projects, designs, etc. in the class. Several kinds of contributions were shown to have statistically significant correlations with performance in the class. A set of two-samplet -tests demonstrate statistical significance of the difference between the means of some contributions from the high-performing and low-performing groups.
9
Analyzing Tables of Statistical Tests
William R. Rice · Evolution · 1989 · 6K citations
The effect of student attributes on success in programming
Pat Byrne, Gerry Lyons · 2001 · 262 citations
Christopher Watson, Frederick W. B. Li, Jamie L. Godwin · 2014 · 174 citations · Full text