Journal of Educational Computing Research · 2025 · 24 citations · 106 references
EducationEducational TechnologyHigher EducationArtificial IntelligenceArtificial Intelligence In EducationInstruction In Higher EducationGenerative Ai In EducationMotivation In LearningArtificial Intelligence EducationEducational ImpactEffect SizeLearner CharacteristicsLearner MotivationModerating EffectsSubject Classification
Generative artificial intelligence (GenAI) has significant potential for educational innovation, although its impact on students’ learning outcomes remains controversial. This study aimed to examine the impact of GenAI on the learning outcomes of K-12 and higher education students, and explore the moderating factors influencing this impact. A meta-analysis of 49 articles showed that the mean effect sizes of GenAI on students’ learning achievement and learning motivation were 0.857 and 0.803, respectively, indicating a positive impact of GenAI on education. However, this effect varied according to moderators, including education level, subject classification, GenAI interface, GenAI development, interaction approaches, and experimentation time, which enhanced the impact of GenAI on education. Specifically, GenAI had a greater impact on the academic performance of higher education students, and students interacted more effectively with GenAI using text than with mixed media, such as images or audio. Although GenAI has a novel effect on students’ learning motivation, the effect size decreases over time. These findings provide empirical support for the beneficial effects of GenAI on education and offer insights for optimizing its use in teaching practices.
106
Bias in meta-analysis detected by a simple, graphical test
Matthias Egger, George Davey Smith, Martin Schneider et al. · BMJ · 1997 · 56.3K citations
Self-efficacy: Toward a unifying theory of behavioral change.
Psychological Review · 1977 · 42.6K citations · Full text
Quantifying heterogeneity in a meta‐analysis
Julian P. T. Higgins, Simon G. Thompson · Statistics in Medicine · 2002 · 36.7K citations