Innovations in Education and Teaching International · 2024 · 29 citations · 34 references
EducationComputer ScienceEducational AssessmentArtificial IntelligenceArtificial Intelligence In EducationNatural Language ProcessingFeedback For LearningFeedback In AssessmentLanguage AssessmentNatural Language Processing In EducationStudent AssessmentWriting AssessmentAutomated Writing EvaluationEssay ClassificationEssay Quality AssessmentForeign Language InstructionHuman Scoring ComparisonWriting Quality Assessment
This study aimed to explore how artificial intelligence (AI) tools compare with humans in evaluating the essays written by students in a writing course. Using a dataset of 30 essays written by English as a foreign language (EFL) students, the evaluations by the AI tools were compared with those of human evaluators, to examine whether the AI evaluations differed with respect to the quality of the entire essay or specific categories (i.e., content, vocabulary, organization, and accuracy). The results indicated that the AI tools provided high-quality feedback to students across all categories despite differences regarding essay quality. Additionally, AI tools differed in the scores they assigned, consistently grading lower than human raters across multiple evaluation categories while providing more detailed feedback than human raters. The scores assigned by each AI tool for student essays across various assessment categories did not differ significantly from the overall scores assigned by AI tools.
34
Exploring the potential of artificial intelligence tools in educational measurement and assessment
Valentine Joseph Owan, Kinsgley Bekom Abang, Delight Omoji Idika et al. · Eurasia Journal of Mathematics Science and Technology Education · 2023 · 374 citations · Full text
Education, Educational Assessment, Educational Measurement +13