Revue d intelligence artificielle · 2021 · 14 citations · 13 references
ComputingComputer ScienceEducational AssessmentIntelligent Tutoring SystemsMachine LearningNatural Language ProcessingLanguage AssessmentNatural Language Processing In EducationQuestion AnsweringAutomated Short-answer ScoringAutomatic GradingKappa CoefficientKappa StatisticQuestion Answering SystemsQuestion Answering Systems Evaluation
A system capable of automatically grading short answers is a very useful tool. The system can be created using machine learning algorithms. In this study, a machine system using BERT is proposed. BERT is an open-source system that is set to English by default. The use of languages other than English Language is a challenge to be implemented in BERT. This study proposes a novel system to implement Indonesian Language in the BERT system for automatic grading of short answers. The experimental results were measured using two measuring instruments: Cohen's Kappa coefficient and the Confusion Matrix. The result of measuring the BERT output of the implemented system has a Cohen Kappa coefficient of 0.75, a precision of 0.94, a recall of 0.96, a Specificity of 0.76 and an F1 Score of 0.95. Based on the measurement results, it can be seen that the implementation of the automatic short answer grading system in Indonesian Language using BERT machine learning has been successful.
13
COBERT: COVID-19 Question Answering System Using BERT
Jafar A. Alzubi, Rachna Jain, Anubhav Singh et al. · Arabian Journal for Science and Engineering · 2021 · 92 citations · Full text
Anique B. H. de Bruin, Ellen M. Kok, Jill Lobbestael et al. · Metacognition and Learning · 2016 · 80 citations · Full text