IEEE Transactions on Instrumentation and Measurement · 2023 · 147 citations · 206 references
ComputingComputer SciencePsychologyComputer VisionFeature EngineeringMachine LearningDeep LearningEmotion RecognitionEmotional ExpressionFace RecognitionFacial ExpressionPattern RecognitionAutomatic Emotion RecognitionFace Representation LearningFacial Expression AnalysisFacial Expression ClassificationFacial Expression ProcessingFacial Expression RecognitionFacial Expression Representation
Emotion recognition plays a significant role in cognitive psychology research. However, measuring emotions is a challenging task. Thus, several approaches have been designed for facial expression recognition (FER). Although, the challenges increase further as the data transit from the laboratory-controlled environment to in-the-wild circumstances, nowadays, applications are overwhelmed by a profusion of deep learning (DL) techniques in real-world problems. DL networks have steadily led to a better understanding of low-dimensional discriminative features from high-dimensional complex face patterns for automatic FER. The modern FER systems based on deep neural networks mainly suffer from two problems: overfitting due to the inadequate availability of training data and complications unassociated with the expressions, such as occlusion, posture, illumination, and identity bias. This study aims to provide a comprehensive survey of the significant DL-based methods that have made a notable contribution to the field of FER. Different components of the methods, such as preprocessing, feature extraction, and classification of facial expressions, are described systematically. Moreover, the discussed approaches are analyzed to compare their performance along with their advantages and limitations. Furthermore, different databases relevant to FER are also explored in this study. Essentially, the main aim of this survey is twofold. The former is to discuss the current scenario of FER approaches and the latter is to present some thoughts on the future directions of facial emotion recognition by machines: what are the obstacles and prospects for FER researchers?
206
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
Rapid object detection using a boosted cascade of simple features
Paul Viola, Michael Jones · 2005 · 18.2K citations
James A. Russell · Journal of Personality and Social Psychology · 1980 · 16K citations
Generative adversarial networks
Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza et al. · Communications of the ACM · 2020 · 13.6K citations · Full text
An argument for basic emotions
Paul Ekman · Cognition & Emotion · 1992 · 9.4K citations