IEEE Transactions on Geoscience and Remote Sensing · 2024 · 22 citations · 49 references
ComputingVision ScienceComputer VisionMachine VisionVisual AttentionFeature-based AttentionFeature-level FusionObject DetectionObject RecognitionSpatial AttentionVideo AnalysisFeature Representation LearningLocal Motion ProcessingMotion SaliencyMultiscale Feature ExtractionRelative Motion ModelingSalient Feature ExtractionSelf-focused AttentionTarget Detection
In temporal infrared small target detection, it is crucial to leverage the disparities in spatiotemporal characteristics between the target and the background to distinguish the former. However, remote imaging and the relative motion between the detection platform and the background cause significant coupling of spatiotemporal characteristics, making target detection highly challenging. To address these challenges, we propose a network named LMAFormer. First, we introduce a local motion-aware spatiotemporal attention mechanism that aligns and enhances multiframe features to extract local spatiotemporal salient features of targets while avoiding interference from moving backgrounds. Second, we employ a multiscale fusion transformer encoder that computes self-attention weights across and within scales during encoding, to establish multiscale correlations among different regions of temporal images, enabling motion background modeling. Last, we propose a multiframe joint query decoder. The shallowest feature map after multiscale feature propagation is mapped to initial query weights, which are refined through grouped convolutions to generate grouped query vectors. These are jointly optimized to encapsulate rich multiframe details, strengthening motion background modeling and target feature representation, improving prediction accuracy. Experimental results on the NUDT-MIRSDT, IRDST, and the established TSIRMT datasets demonstrate that our network outperforms state-of-the-art (SOTA) methods. Our code and dataset will be available at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/lifier/LMAFormer</uri>.
49
Feature Pyramid Networks for Object Detection
Tsung-Yi Lin, Piotr Dollár, Ross Girshick et al. · 2017 · 28.7K citations
Ze Liu, Ning Jia, Yue Cao et al. · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · 2022 · 1.9K citations
Dense Nested Attention Network for Infrared Small Target Detection
Boyang Li, Chao Xiao, Longguang Wang et al. · IEEE Transactions on Image Processing · 2022 · 867 citations · Full text