Multiview Classification With Cohesion and Diversity

Abstract

Different views of multiview data share certain common information (consensus) and also contain some complementary information (complementarity). Both consensus and complementarity are of significant importance to the success of multiview learning. In this paper, we explicitly formulate both of them for multiview classification. On the one hand, a cohesion-increasing loss term with a learnable label-adjusting matrix is designed to facilitate consensus among views in the training stage. With this kind of loss, the learned classifiers of all views are more likely to obtain the correct classification, thereby maximizing the agreement among views. On the other hand, an independence measurement is adopted as the diversity-promoting regularization to encourage classifiers to be diverse such that more complementary information can be captured by these "diversified" classifiers. Overall, the resultant model is capable of achieving more comprehensive and accurate classification by exploring and exploiting the common and complementary information across multiple views more thoroughly. An iterative optimization algorithm with proved convergence is proposed for training the model. Extensive experimental results on various datasets have demonstrated the efficacy of the proposed method.