Frontiers in Computer Science · 2023 · 24 citations · 27 references
EngineeringBioengineeringBiomedical EngineeringBioinstrumentationBiomedical Signal ProcessingMachine LearningAffective ComputingEmotion RecognitionPhysiological Signal AcquisitionSupport Vector MachinesWearable BiosensorsWearable Health TechnologiesK-nearest NeighborsMulti-modal Physiological SensingMultimodal Emotion RecognitionMultimodal Physiological MonitoringPhysiological Signal AnalysisPhysiological Signal CollectionPhysiological Signal MonitoringPhysiological Signal Processing
Introduction Healthcare wearables allow researchers to develop various system approaches that recognize and understand the human emotional experience. Previous research has indicated that machine learning classifiers, such as Support Vector Machine (SVM), K-Nearest Neighbors (KNN), and Decision Tree (DT), can improve the accuracy of physiological signal analysis and emotion recognition. However, various emotions can have distinct effects on physiological signal alterations. Therefore, solely relying on a single type of physiological signal analysis is insufficient for accurately recognizing and understanding human emotional experiences. Methods Research on multi-modal emotion recognition systems (ERS) has commonly gathered physiological signals using expensive devices, which required participants to remain in fixed positions in the lab setting. This limitation restricts the potential for generalizing the ERS technology for peripheral use in daily life. Therefore, considering the convenience of data collection from everyday devices, we propose a multi-modal physiological signals-based ERS based on peripheral signals, utilizing the DEAP database. The physiological signals selected for analysis include photoplethysmography (PPG), galvanic skin response (GSR), and skin temperature (SKT). Signal features were extracted using the “Toolbox for Emotional Feature Extraction from Physiological Signals” (TEAP) library and further analyzed with three classifiers: SVM, KNN, and DT. Results The results showed improved accuracy in the proposed system compared to a single-modal ERS application, which also outperformed current DEAP multi-modal ERS applications. Discussion This study sheds light on the potential of combining multi-modal peripheral physiological signals in ERS for ubiquitous applications in daily life, conveniently captured using smart devices.
27
DEAP: A Database for Emotion Analysis ;Using Physiological Signals
Sander Koelstra, Christian Mühl, Mohammad Soleymani et al. · IEEE Transactions on Affective Computing · 2011 · 4.8K citations · Full text
Nursing, Neuroscience, Psychology +17
The emotion probe: Studies of motivation and attention.
Peter J. Lang · American Psychologist · 1995 · 1.8K citations
Introducing WESAD, a Multimodal Dataset for Wearable Stress and Affect Detection
Philip Schmidt, Attila Reiss, Robert Duerichen et al. · 2018 · 1.2K citations