International Journal of Neural Systems · 2023 · 10 citations · 63 references
Social SciencesPsychiatryPsychologyAffective NeuroscienceNonverbal CommunicationVisual PerceptionEmotion PerceptionEmotion RecognitionEmotional ExpressionFace PerceptionFacial PerceptionVirtual RealityEmotion Perception AccuracyEmotion Perception In FacesEmotionsFacial Action UnitsFacial Affect RecognitionFacial Emotion PerceptionHuman InteractionsImmersive Virtual Reality
Facial affect recognition is a critical skill in human interactions that is often impaired in psychiatric disorders. To address this challenge, tests have been developed to measure and train this skill. Recently, virtual human (VH) and virtual reality (VR) technologies have emerged as novel tools for this purpose. This study investigates the unique contributions of different factors in the communication and perception of emotions conveyed by VHs. Specifically, it examines the effects of the use of action units (AUs) in virtual faces, the positioning of the VH (frontal or mid-profile), and the level of immersion in the VR environment (desktop screen versus immersive VR). Thirty-six healthy subjects participated in each condition. Dynamic virtual faces (DVFs), VHs with facial animations, were used to represent the six basic emotions and the neutral expression. The results highlight the important role of the accurate implementation of AUs in virtual faces for emotion recognition. Furthermore, it is observed that frontal views outperform mid-profile views in both test conditions, while immersive VR shows a slight improvement in emotion recognition. This study provides novel insights into the influence of these factors on emotion perception and advances the understanding and application of these technologies for effective facial emotion recognition training.
63
Grigore Burdea, Philippe Coiffet · PRESENCE Virtual and Augmented Reality · 2003 · 2.3K citations
What is Meant by Calling Emotions Basic
Paul Ekman, Daniel T. Cordaro · Emotion Review · 2011 · 1.3K citations
Deciphering the Enigmatic Face
Zara Ambadar, Jonathan W. Schooler, Jeffrey F. Cohn · Psychological Science · 2005 · 648 citations