Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · 2021 · 100 citations · 60 references
ComputingBehavioral SciencesAffective NeurosciencePsychophysiologyUser Experience DesignAffective ComputingAffective State DetectionEmotion RecognitionVirtual RealityVirtual Reality Experience DesignVirtual WorldsAffective Experience DesignEmotion-aware Human-computer InteractionEmotionsImmersive Video EnvironmentsImmersive Virtual RealityMultimodal Affective ComputingNon-immersive Virtual RealityVirtual Avatars
The paper introduces a multimodal affective dataset named VREED (VR Eyes: Emotions Dataset) in which emotions were triggered using immersive 360° Video-Based Virtual Environments (360-VEs) delivered via Virtual Reality (VR) headset. Behavioural (eye tracking) and physiological signals (Electrocardiogram (ECG) and Galvanic Skin Response (GSR)) were captured, together with self-reported responses, from healthy participants (n=34) experiencing 360-VEs (n=12, 1--3 min each) selected through focus groups and a pilot trial. Statistical analysis confirmed the validity of the selected 360-VEs in eliciting the desired emotions. Preliminary machine learning analysis was carried out, demonstrating state-of-the-art performance reported in affective computing literature using non-immersive modalities. VREED is among the first multimodal VR datasets in emotion recognition using behavioural and physiological signals. VREED is made publicly available on Kaggle1. We hope that this contribution encourages other researchers to utilise VREED further to understand emotional responses in VR and ultimately enhance VR experiences design in applications where emotional elicitation plays a key role, i.e. healthcare, gaming, education, etc.
60
James A. Russell · Journal of Personality and Social Psychology · 1980 · 16K citations
Scikit-learn: Machine Learning in Python
PedregosaFabian, VaroquauxGaël, GramfortAlexandre et al. · Journal of Machine Learning Research · 2011 · 8.2K citations
DEAP: A Database for Emotion Analysis ;Using Physiological Signals
Sander Koelstra, Christian Mühl, Mohammad Soleymani et al. · IEEE Transactions on Affective Computing · 2011 · 4.8K citations · Full text
Nursing, Neuroscience, Psychology +17