2018 · 169 citations · 29 references
ComputingComputer ScienceComputer VisionInformation RetrievalMachine LearningDeep LearningHash FunctionsImage RetrievalMatrix FactorizationRepresentation LearningUnsupervised LearningCross-modal RetrievalDeep Feature LearningFeature LearningHashingLatent Factor ModelsLatent Feature LearningMultimodal RetrievalUnsupervised Feature Learning
Despite its great success, matrix factorization based cross-modality hashing suffers from two problems: 1) there is no engagement between feature learning and binarization; and 2) most existing methods impose the relaxation strategy by discarding the discrete constraints when learning the hash function, which usually yields suboptimal solutions. In this paper, we propose a novel multimodal hashing framework, referred as Unsupervised Deep Cross-Modal Hashing (UDCMH), for multimodal data search in a self-taught manner via integrating deep learning and matrix factorization with binary latent factor models. On one hand, our unsupervised deep learning framework enables the feature learning to be jointly optimized with the binarization. On the other hand, the hashing system based on the binary latent factor models can generate unified binary codes by solving a discrete-constrained objective function directly with no need for a relaxation step. Moreover, novel Laplacian constraints are incorporated into the objective function, which allow to preserve not only the nearest neighbors that are commonly considered in the literature but also the farthest neighbors of data, even if the semantic labels are not available. Extensive experiments on multiple datasets highlight the superiority of the proposed framework over several state-of-the-art baselines.
29
Yangqing Jia, Evan Shelhamer, Jeff Donahue et al. · 2014 · 11.2K citations
Caffe: Convolutional Architecture for Fast Feature Embedding
Yangqing Jia, Evan Shelhamer, Jeff Donahue et al. · arXiv (Cornell University) · 2014 · 4.3K citations · Full text
Tat‐Seng Chua, Jinhui Tang, Richang Hong et al. · 2009 · 3K citations
The MIR flickr retrieval evaluation
Mark J. Huiskes, Michael S. Lew · 2008 · 1.8K citations