2023 · 35 citations · 39 references
ComputingComputer ScienceComputer VisionMachine LearningNatural Language ProcessingDeep LearningImage RetrievalMeta-learningMultimedia RetrievalMultimodal CorporaPattern RecognitionBinary ClassificationCross-modal Image RetrievalCross-modal RetrievalCrossmodal CorrespondenceMulti-modal RetrievalMultimodal Representation LearningMultimodal RetrievalPerformance Degradation
Despite the success of multimodal learning in crossmodal retrieval task, the remarkable progress relies on the correct correspondence among multimedia data. However, collecting such ideal data is expensive and time-consuming. In practice, most widely used datasets are harvested from the Internet and inevitably contain mismatched pairs. Training on such noisy correspondence datasets causes performance degradation because the cross-modal retrieval methods can wrongly enforce the mismatched data to be similar. To tackle this problem, we propose a Meta Similarity Correction Network (MSCN) to provide reliable similarity scores. We view a binary classification task as the meta-process that encourages the MSCN to learn discrimination from positive and negative meta-data. To further alleviate the influence of noise, we design an effective data purification strategy using meta-data as prior knowledge to remove the noisy samples. Extensive experiments are conducted to demonstrate the strengths of our method in both synthetic and real-world noises, including Flickr30K, MS-COCO, and Conceptual Captions. Our code is publicly available. <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup> <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup> https://github.com/hhc1997/MSCN
39
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
The global k-means clustering algorithm
Aristidis Likas, Nikos Vlassis, Jakob Verbeek · Pattern Recognition · 2002 · 3.7K citations · Full text
Peter Young, Alice Lai, Micah Hodosh et al. · Transactions of the Association for Computational Linguistics · 2014 · 2.5K citations · Full text