Facial Emotion Recognition Using an Ensemble of Multi-Level Convolutional Neural Networks

Hai-Duong Nguyen, Soonja Yeom, Guee-Sang Lee, Hyung-Jeong Yang, In Seop Na, Soo-Hyung Kim

International Journal of Pattern Recognition and Artificial Intelligence · 2018 · 66 citations · 19 references

DOIFull text

Open access

Concepts

Abstract

Emotion recognition plays an indispensable role in human–machine interaction system. The process includes finding interesting facial regions in images and classifying them into one of seven classes: angry, disgust, fear, happy, neutral, sad, and surprise. Although many breakthroughs have been made in image classification, especially in facial expression recognition, this research area is still challenging in terms of wild sampling environment. In this paper, we used multi-level features in a convolutional neural network for facial expression recognition. Based on our observations, we introduced various network connections to improve the classification task. By combining the proposed network connections, our method achieved competitive results compared to state-of-the-art methods on the FER2013 dataset.

References

19