2005 · 62 citations · 18 references
ComputingComputer ScienceArtificial IntelligenceMachine LearningSensor FusionAffective ComputingAffective State DetectionEmotion RecognitionHidden Markov ModelsMultimodal InteractionPattern RecognitionAffective State AssessmentAffective State InferenceAffective State RecognitionEmotion Recognition In InteractionMaximum Entropy PrincipleMaximum Mutual InformationMultimodal Affective State RecognitionMultimodal Emotion Recognition
Advances in computer processing power and emerging algorithms are allowing new ways of envisioning human computer interaction. This paper focuses on the development of a computing algorithm that uses audio and visual sensors to detect and track a user's affective state to aid computer decision making. Using our multi-stream fused hidden Markov model (MFHMM), we analyzed coupled audio and visual streams to detect 11 cognitive/emotive states. The MFHMM allows the building of an optimal connection among multiple streams according to the maximum entropy principle and the maximum mutual information criterion. Person-independent experimental results from 20 subjects in 660 sequences show that the MFHMM approach performs with an accuracy of 80.61% which outperforms face-only HMM, pitch-only HMM, energy-only HMM, and independent HMM fusion.
18
Coupled hidden Markov models for complex action recognition
Matthew Brand, Nuria Oliver, Alex Pentland · 2002 · 1.1K citations
Analysis of emotion recognition using facial expressions, speech and multimodal information
Carlos Busso, Zhigang Deng, Murtaza Bulut et al. · 2004 · 832 citations
A. Mechrabian · Medical Entomology and Zoology · 1968 · 402 citations