Electronics · 2020 · 23 citations · 45 references
ComputingCommunicationComputer ScienceAssistive TechnologyAutism Spectrum DisordersPsychophysiologyAffect AssessmentAffective ComputingAffective State DetectionDeep LearningEmotion ProcessingEmotion RecognitionAffect ClassificationAffective State AssessmentAffective State RecognitionAutomatic Emotion DetectionDiscrete Wavelet TransformPhysiological Signal AnalysisPhysiological Signal ProcessingWavelet Transform
Non-verbal communication is essential in the communication process. This means that its lack can cause misinterpretations of the message that the sender tries to transmit to the receiver. With the rise of video calls, it seems that this problem has been partially solved. However, people with cognitive disorders such as those with some kind of Autism Spectrum Disorder (ASD) are unable to interpret non-verbal communication neither live nor by video call. This work analyzes the relationship between some physiological measures (EEG, ECG, and GSR) and the affective state of the user. To do that, some public datasets are evaluated and used for a multiple Deep Learning (DL) system. Each physiological signal is pre-processed using a feature extraction process after a frequency study with the Discrete Wavelet Transform (DWT), and those coefficients are used as inputs for a single DL classifier focused on that signal. These multiple classifiers (one for each signal) are evaluated independently and their outputs are combined in order to optimize the results and obtain additional information about the most reliable signals for classifying the affective states into three levels: low, middle, and high. The full system is carefully detailed and tested, obtaining promising results (more than 95% accuracy) that demonstrate its viability.
45
Looking at pictures: Affective, facial, visceral, and behavioral reactions
Peter J. Lang, Mark K. Greenwald, Margaret M. Bradley et al. · Psychophysiology · 1993 · 3.2K citations
Facial expression and emotion.
Paul Ekman · American Psychologist · 1993 · 2.4K citations
The emotion probe: Studies of motivation and attention.
Peter J. Lang · American Psychologist · 1995 · 2.3K citations