Human-centric Computing and Information Sciences · 2012 · 18 citations · 21 references
ComputingComputer ScienceEducational TechnologyComputer VisionHuman-computer InteractionIntelligent Tutoring SystemsAction RecognitionAffective ComputingAffective Computing In EducationAffective State DetectionGesture AnalysisGesture RecognitionBinary CodesGesture InterpretationHand Gesture AnalysisHand GesturesIntelligent Tutoring DialoguesLocal Binary PatternsMental State ClassificationMental State Representation
Abstract Background In this paper, we report on development of a non-intrusive student mental state prediction system from his (her) unintentional hand-touch-head (face) movements. Methods Hand-touch-head (face) movement is a typical case of occlusion of otherwise easily detectable image features due to similar skin color and texture, however, in our proposed scheme, i.e., the Sobel-operated local binary pattern (SLBP) method using force field features. We code six different gestures of more than 100 human subjects, and use these codes as manual input to a three-layered Bayesian network (BN). The first layer holds mental state to gesture relationships obtained in an earlier study while the second layer embeds gesture and SLBP generated binary codes. Results We find it very successful in separating hand (s) from face region in varying illuminating conditions. The proposed scheme when evaluated on a novel data set is found promising resulting with an accuracy of about 85%. Conclusion The framework will be utilized for developing intelligent tutoring system.
21
John R. Anderson, C. Franklin Boyle, Brian J. Reiser · Science · 1985 · 3.1K citations
Education, Educational Technology, Artificial Intelligence +4
Emotion recognition in human-computer interaction
Roddy Cowie, Ellen Douglas‐Cowie, Nicolas Tsapatsoulis et al. · IEEE Signal Processing Magazine · 2001 · 2.6K citations · Full text
Computing, Linguistics, Psychology +17