IEEE Transactions on Circuits and Systems for Video Technology · 2024 · 29 citations · 59 references
ComputingComputer ScienceInformation RetrievalMachine LearningNatural Language ProcessingMultimedia RetrievalTransfer LearningAccuracyBenchmark DatasetsCross-domain TransferCross-modal Representation LearningCross-modal RetrievalMultimodal Retrieval ModelsParameter TransferRetrieval
Unsupervised cross-modal hashing presents significant advantages in heterogeneous modality retrieval, offering label scalability, high retrieval efficiency, and low storage costs. However, the lack of explicit semantic supervision in this process results in a noticeable semantic deficit, impacting retrieval performance. In this paper, we address this challenge with a dual-pronged approach: Cross-Domain Transfer Hashing (CDTH), a lightweight weakly-supervised cross-modal hashing model. Our method leverages a semantically rich auxiliary domain to augment the target unsupervised cross-modal hash learning process. Simultaneously, we design a lightweight target cross-modal hashing network to reduce semantic requirements, lessening the burden of parameter optimization. Within the auxiliary domain, we perform direct semantic transfer with hashing network parameter transfer and indirect correlation semantic transfer by constructing an auxiliary semantic correlation graph with the identified cross-domain semantic consistent samples. In the target domain, we generate pseudo-labels using CLIP and establish a target weak semantic correlation graph. These two graphs collaborate to bolster the target cross-modal hashing training process. Extensive experiments on three publicly available datasets affirm the superiority of our approach in both retrieval accuracy and training efficiency. The source code for our method is accessible at: https://github.com/WangBowen7/CDTH.
59
A Comprehensive Survey on Transfer Learning
Fuzhen Zhuang, Zhiyuan Qi, Keyu Duan et al. · Proceedings of the IEEE · 2020 · 6.2K citations
Tat‐Seng Chua, Jinhui Tang, Richang Hong et al. · 2009 · 3K citations
Maximum Classifier Discrepancy for Unsupervised Domain Adaptation
Kuniaki Saito, Kohei Watanabe, Yoshitaka Ushiku et al. · 2018 · 2.2K citations
Deep visual domain adaptation: A survey
Mei Wang, Weihong Deng · Neurocomputing · 2018 · 2.2K citations · Full text