Facial expression recognition using bidirectional LSTM - CNN

Abstract

Nowadays, there has been much attention on computer vision regarding human-computer interaction, especially facial expression recognition (FER). Many researchers have explored and suggested systems for this field. In this paper, we propose the Deep Learning architecture to improve the performance of models from the previous work. Additionally, we propose the BiLSTM-CNN model, which combines our proposed CNN and BiLSTM model. Besides that, we also compare the model to our CNN and LSTM-CNN models. We conduct the experiments on the CK+ dataset and evaluate the accuracy rate of the built models. Data augmentation is used in the dataset to improve the model's performance and prevent overfitting. The results demonstrate that the BiLSTM-CNN method achieves a state-of-the-art accuracy rate compared to other methods from previous work. The highest accuracy of 99.43% is reached by the BiLSTM-CNN model with data augmentation.