2014 · 19 citations · 25 references
ComputingComputer ScienceComputer VisionFeature EngineeringMachine LearningDimensionality ReductionEmotion RecognitionFace RecognitionFacial ExpressionRepresentation LearningFacial Expression AnalysisNon-contributing FeaturesRegularizationWeakly Supervised LabelingWeakly Supervised Learning
In this work, we address the problem of estimating high-level semantic labels for videos of recorded people by means of analysing their facial expressions. This problem, to which we refer as facial behavior categorization, is a weakly-supervised learning problem where we do not have access to frame-by-frame facial gesture annotations but only weak-labels at the video level are available. Therefore, the goal is to learn a set of discriminative expressions appearing during the training videos and how they determine these labels. Facial behavior categorization can be posed as a Multi-Instance-Learning (MIL) problem and we propose a novel MIL method called Regularized Multi-Concept MIL to solve it. In contrast to previous approaches applied in facial behavior analysis, RMC-MIL follows a Multi-Concept assumption which allows different facial expressions (concepts) to contribute differently to the video-label. Moreover, to handle with the high-dimensional nature of facial-descriptors, RMC-MIL uses a discriminative approach to model the concepts and structured sparsity regularization to discard non-informative features. RMC-MIL is posed as a convex-constrained optimization problem where all the parameters are jointly learned using the Projected-Quasi-Newton method. In our experiments, we use two public data-sets to show the advantages of the Regularized MultiConcept approach and its improvement compared to existing MIL methods. RMC-MIL outperforms state-of-the-art results in the UNBC data-set for pain detection.
25
Supervised Descent Method and Its Applications to Face Alignment
Xuehan Xiong, Fernando De la Torre · 2013 · 1.9K citations · Full text
A 3-dimensional sift descriptor and its application to action recognition
Paul Scovanner, Saad Ali, Mubarak Shah · 2007 · 1.6K citations · Full text
Support Vector Machines for Multiple-Instance Learning
Stuart Andrews, Ioannis Tsochantaridis, Thomas Hofmann · 2002 · 1.4K citations
A Framework for Multiple-Instance Learning
Oded Maron, Tomás Lozano‐Pérez · 1997 · 1.2K citations