Video Emotion Recognition with Concept Selection

Abstract

Understanding video content is a challenging problem in many applications, especially for emotion analysis. Diverse and complicated video contents are the major obstacles in video emotion understanding. In this paper, we propose a modality fusion framework to combine concept and content features from action, scene and object models. We conduct concept selection to investigate the relations between high-level concept features and emotions. The discriminative concepts play important roles in emotion recognition. Fusing different modality of content features further improve the performance. The extensive experiments show the state-of-the-art results on two challenging video emotion benchmarks.