IEEE Transactions on Industrial Informatics · 2024 · 100 citations · 35 references
ComputingComputer ScienceComputer VisionMachine LearningRoboticsDeep LearningEmotion RecognitionFace RecognitionFacial ExpressionPattern RecognitionRepresentation LearningFace Representation LearningFacial Expression AnalysisFacial Expression RecognitionFacial Expression RepresentationFacial MusclesMotion Representation LearningSemantic RelationshipsVision Transformers
How to automatically recognize facial expression has caused concerns in industrial human–robot interaction. However, facial expression recognition (FER) is susceptible to problems, such as occlusion, arbitrary orientations, and illumination. To effectively address these challenges in FER, we present a novel facial muscle movement aware representation learning that can learn the semantic relationships of facial muscle movements in facial expression images. Two key findings are revealed: 1) muscle movements from different facial regions often show semantic relationships; and 2) not all facial muscle regions have equal contributions for different facial expressions. On this basis, this model presents two novel modules, namely, discriminative feature generation (DFG) and muscle relationship mining (MRM). Specifically, in DFG, the memory of our model for mislabeling decreases. In MRM, muscle–motion interaction among diverse facial regions is learned through visual transformers (MMATrans). Experiments on three in-the-wild FER datasets (RAF-DB, FERPlus, and AffectNet) show that our MMATrans yields better performance compared with state-of-the-art methods.
35
Suppressing Uncertainties for Large-Scale Facial Expression Recognition
Kai Wang, Xiaojiang Peng, Jianfei Yang et al. · 2020 · 687 citations