2024 · 11 citations · 20 references
ComputingComputer ScienceComputer VisionInformation RetrievalNatural Language ProcessingFeature DescriptionImage Feature EngineeringImage RetrievalRepresentation LearningSemantic SearchText Feature EngineeringDeep Feature LearningFeature LearningImage-text AlignmentImage-text RetrievalLatent Feature LearningLearned Feature RepresentationsMultimodal Representation LearningPerson-related Retrieval
Text-based person retrieval aims to search for target persons based on a given text description query. However, existing methods often have the following problems: (1) Ignoring local attribute information between different persons in feature learning, which results in the low distinguishability of similar people's feature representations. (2) Lacking fine-grained semantics alignment between visual images and text descriptions, which leads to inconsistency in person details between query and target. To address these issues, we propose a <u>F</u>ine-grained <u>S</u>emantics-aware <u>R</u>epresentation <u>L</u>earning (<u>FSRL</u>) method that establishing intra-modal local attribute correlations and inter-modal fine-grained semantic correlations. Specifically, we first design an identity self-distillation module, which explores soft identity labels that reflect local attribute similarities among different people. The soft identity labels assist the model in learning discriminative features associated with fine-grained attributes of persons. Secondly, we propose a visual-language relationship modeling module that enforces the model to proofread "error words" randomly changed in text during the cross-modal interaction process to establish fine-grained image-text semantic correlations. Extensive experiments show that the proposed method achieves new state-of-the-art results on three benchmark datasets and also performs well on the domain generalization task. Our code is available at https://github.com/y416f/FSRL.
20
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
VQA: Visual Question Answering
Stanislaw Antol, Aishwarya Agrawal, Jiasen Lu et al. · 2015 · 4.3K citations
Bag of Tricks and a Strong Baseline for Deep Person Re-Identification
Hao Luo, Youzhi Gu, Xingyu Liao et al. · 2019 · 1.5K citations