2017 · 73 citations · 18 references
ComputingComputer ScienceComputer VisionFeature EngineeringMachine LearningDeep LearningEmotion RecognitionEmotional ExpressionFace RecognitionFacial ExpressionRepresentation LearningAutomatic Emotion RecognitionConvolutional Neural NetworksData AugmentationEmotion DetectionEmotion PredictionFacial Expression ClassificationFacial Expression RecognitionGroup Emotion
This paper presents our approach for group-level emotion recognition in the Emotion Recognition in the Wild Challenge 2017. The task is to classify an image into one of the group emotion such as positive, neutral or negative. Our approach is based on two types of Convolutional Neural Networks (CNNs), namely individual facial emotion CNNs and global image based CNNs. For the individual facial emotion CNNs, we first extract all the faces in an image, and assign the image label to all faces for training. In particular, we utilize a large-margin softmax loss for discriminative learning and we train two CNNs on both aligned and non-aligned faces. For the global image based CNNs, we compare several recent state-of-the-art network structures and data augmentation strategies to boost performance. For a test image, we average the scores from all faces and the image to predict the final group emotion category. We win the challenge with accuracies 83.9% and 80.9% on the validation set and testing set respectively, which improve the baseline results by about 30%.
18
ImageNet: A large-scale hierarchical image database
Jia Deng, Wei Dong, Richard Socher et al. · 2009 IEEE Conference on Computer Vision and Pattern Recognition · 2009 · 61.8K citations
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · arXiv (Cornell University) · 2015 · 4.7K citations · Full text