2021 · 17 citations · 24 references
ComputingComputer ScienceComputer VisionMachine LearningNatural Language ProcessingAffective ComputingAffective State DetectionDeep LearningEmotion RecognitionEmotional ExpressionFacial ExpressionAffectAffect PredictionCausal Inference In PredictionCausal Network InferenceCausal Network ModelingEmotion PredictionFacial Expression RecognitionReal-time Emotion Recognition
Among human affective behavior research, facial expression recognition research is improving in performance along with the development of deep learning. For improved performance, not only past images but also future images should be used along with corresponding facial images, but there are obstacles to the application of this technique to real-time environments. In this paper, we propose the causal affect prediction network (CAPNet), which uses only past facial images to predict corresponding affective valence and arousal. We train CAPNet to learn causal inference between past images and corresponding affective valence and arousal through supervised learning by pairing the sequence of past images with the current label using the Aff-Wild2 dataset. We show through experiments that the well-trained CAPNet outperforms the baseline of the second challenge of the Affective Behavior Analysis in-the-wild (ABAW2) Competition by predicting affective valence and arousal only with past facial images one-third of a second earlier. Therefore, in real-time application, CAPNet can reliably predict affective valence and arousal only with past data.The code is publicly available. <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup>
24
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
James A. Russell · Journal of Personality and Social Psychology · 1980 · 16K citations
Squeeze-and-Excitation Networks
Jie Hu, Li Shen, Samuel Albanie et al. · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2019 · 12.5K citations
Aggregated Residual Transformations for Deep Neural Networks
Saining Xie, Ross Girshick, Piotr Dollár et al. · 2017 · 11.9K citations