Open Computer Science · 2019 · 14 citations · 29 references
EducationComputer SciencePsychologyIntelligent Tutoring SystemsNonverbal CommunicationStudent EngagementAffective ComputingAffective Computing In EducationEmotion ProcessingEmotion RecognitionEmotional ExpressionFacial ExpressionAdaptive Learning TechnologiesAutomatic Emotion RecognitionEmotion Recognition From Nonverbal BehaviorEmotionsFacial Affect AnalysisFacial Affect RecognitionSelf-report MeasurementSelf-report Scales
Abstract Measuring emotions non-intrusively via affective computing provides a promising source of information for adaptive learning and intelligent tutoring systems. Using non-intrusive, simultaneous measures of emotions, such systems could steadily adapt to students emotional states. One drawback, however, is the lack of evidence on how such modern measures of emotions relate to traditional self-reports. The aim of this study was to compare a prominent area of affective computing, facial emotion recognition, to students’ self-reports of interest, boredom, and valence. We analyzed different types of aggregation of the simultaneous facial emotion recognition estimates and compared them to self-reports after reading a text. Analyses of 103 students revealed no relationship between the aggregated facial emotion recognition estimates of the software FaceReader and self-reports. Irrespective of different types of aggregation of the facial emotion recognition estimates, neither the epistemic emotions ( i.e. , boredom and interest), nor the estimates of valence predicted the respective self-report measure. We conclude that assumptions on the subjective experience of emotions cannot necessarily be transferred to other emotional components, such as estimated by affective computing. We advise to wait for more comprehensive evidence on the predictive validity of facial emotion recognition for learning before relying on it in educational practice.
29
James A. Russell · Journal of Personality and Social Psychology · 1980 · 16K citations
Rudolph Flesch · Journal of Applied Psychology · 1948 · 5.2K citations
What are emotions? And how can they be measured?
Klaus R. Scherer · Social Science Information · 2005 · 4.1K citations