IEEE Transactions on Image Processing · 2016 · 23 citations · 53 references
ComputingComputer ScienceComputer VisionFeature EngineeringMachine LearningAction RecognitionEmotion RecognitionFace RecognitionFacial ExpressionFeature-level FusionRepresentation LearningCross-modal FusionFacial Action UnitsFeature FusionMonte Carlo SamplingMultimodal Feature FusionMultimodal Feature RepresentationPosed Facial ExpressionsRepresentation Fusion
Automated analysis of facial expressions can benefit many domains, from marketing to clinical diagnosis of neurodevelopmental disorders. Facial expressions are typically encoded as a combination of facial muscle activations, i.e., action units. Depending on context, these action units co-occur in specific patterns, and rarely in isolation. Yet, most existing methods for automatic action unit detection fail to exploit dependencies among them, and the corresponding facial features. To address this, we propose a novel multi-conditional latent variable model for simultaneous fusion of facial features and joint action unit detection. Specifically, the proposed model performs feature fusion in a generative fashion via a low-dimensional shared subspace, while simultaneously performing action unit detection using a discriminative classification approach. We show that by combining the merits of both approaches, the proposed methodology outperforms existing purely discriminative/generative methods for the target task. To reduce the number of parameters, and avoid overfitting, a novel Bayesian learning approach based on Monte Carlo sampling is proposed, to integrate out the shared subspace. We validate the proposed method on posed and spontaneous data from three publicly available datasets (CK+, DISFA and Shoulder-pain), and show that both feature fusion and joint learning of action units leads to improved performance compared to the state-of-the-art methods for the task.
53
Pattern Recognition and Machine Learning
Journal of Electronic Imaging · 2007 · 22.1K citations
ML-KNN: A lazy learning approach to multi-label learning
Min-Ling Zhang, Zhi‐Hua Zhou · Pattern Recognition · 2007 · 3.5K citations
Grigorios Tsoumakas, Ioannis Katakis · International Journal of Data Warehousing and Mining · 2007 · 2.5K citations