IEEE Transactions on Pattern Analysis and Machine Intelligence · 2015 · 33 citations · 66 references
ComputingComputer ScienceComputer VisionLocalizationMachine LearningBayesian InferenceBayesian LearningGenerative ModelingObject DetectionObject RecognitionTransfer LearningBayesian Topic ModelsDomain AdaptationLearningPrior Related KnowledgeWeakly Supervised Image ClassificationWeakly Supervised LearningWeakly Supervised Object DetectionWeakly Supervised Object Recognition
We address the problem of localisation of objects as bounding boxes in images and videos with weak labels. This weakly supervised object localisation problem has been tackled in the past using discriminative models where each object class is localised independently from other classes. In this paper, a novel framework based on Bayesian joint topic modelling is proposed, which differs significantly from the existing ones in that: (1) All foreground object classes are modelled jointly in a single generative model that encodes multiple object co-existence so that "explaining away" inference can resolve ambiguity and lead to better learning and localisation. (2) Image backgrounds are shared across classes to better learn varying surroundings and "push out" objects of interest. (3) Our model can be learned with a mixture of weakly labelled and unlabelled data, allowing the large volume of unlabelled images on the Internet to be exploited for learning. Moreover, the Bayesian formulation enables the exploitation of various types of prior knowledge to compensate for the limited supervision offered by weakly labelled data, as well as Bayesian domain adaptation for transfer learning. Extensive experiments on the PASCAL VOC, ImageNet and YouTube-Object videos datasets demonstrate the effectiveness of our Bayesian joint model for weakly supervised object localisation.
66
ImageNet: A large-scale hierarchical image database
Jia Deng, Wei Dong, Richard Socher et al. · 2009 IEEE Conference on Computer Vision and Pattern Recognition · 2009 · 61.8K citations
Sinno Jialin Pan, Qiang Yang · IEEE Transactions on Knowledge and Data Engineering · 2009 · 23.2K citations
Pattern Recognition and Machine Learning
Journal of Electronic Imaging · 2007 · 22.1K citations