IEEE Transactions on Knowledge and Data Engineering · 2023 · 27 citations · 55 references
ComputingComputer ScienceDatabasesInformation RetrievalKnowledge RepresentationData CompressionHash FunctionsHash TablesRetrieval ModelsAsymmetric StrategyCross-modal MatchingCross-modal RetrievalHashingMultimodal RetrievalRetrievalSemantic HashingSimilarity Search
Hashing-based techniques present appealing solutions for cross-modal retrieval due to its low storage requirements and excellent query efficiency. The majority of cross-modal hashing methods typically adopt equal-length encoding scheme to represent multimodal data and achieve cross-modal similarity search. However, such scheme can be regarded as a relatively strict limitation, because it sacrifices the flexible representation of multimodal data in reality and cannot always guarantee the optimal retrieval performance. To address the challenge, this paper focuses on encoding heterogeneous data with varying hash lengths. To achieve this purpose, we propose a flexible cross-modal hashing approach, named Two-stage Asymmetric Similarity Preserving Hashing, TASPH for short, which can be applied to both unequal-length and equal-length retrieval scenarios. Specifically, in the first stage, TASPH designs a novel discrete asymmetric strategy to learn the modality-specific hash codes with varying lengths, enabling a flexible representation of heterogeneous data. Simultaneously, TASPH utilizes two semantic transformation matrices to establish the semantic correlations between varying hash codes. Different from most of the existing approaches that employ relaxation solutions, TASPH satisfies the discrete constraints without any relaxation. In the second stage, the learned semantic transformation matrices are employed to alleviate cross-modal heterogeneity, which guarantees that TASPH can learn more powerful hash functions to improve the discriminative ability of hash codes. Abundant experiments conducted on three benchmark datasets demonstrate encouraging results compared with the state-of-the-art approaches under different retrieval scenarios.
55
Return of the Devil in the Details: Delving Deep into Convolutional Nets
Ken Chatfield, Karen Simonyan, Andrea Vedaldi et al. · 2014 · 3.1K citations
Tat‐Seng Chua, Jinhui Tang, Richang Hong et al. · 2009 · 3K citations
The MIR flickr retrieval evaluation
Mark J. Huiskes, Michael S. Lew · 2008 · 1.8K citations
Fumin Shen, Chunhua Shen, Wei Liu et al. · 2015 · 1.2K citations