IEEE Signal Processing Letters · 2022 · 15 citations · 37 references
ComputingComputer ScienceComputer VisionFeature EngineeringVisual AttentionAttention NetworksDeep LearningFeature DescriptionFeature DetectionObject DetectionObject RecognitionBenchmark DatasetsContextual DependenciesConvolutional Neural NetworksCross-modal InteractionsCross-modal Object DetectionSalient Object DetectionTransformer-based Object DetectionVisual Saliency Detection
Video salient object detection (VSOD) aims at locating the most attractive objects presented in video sequences by exploiting spatial and temporal cues. Previous methods mainly utilize convolutional neural networks (CNNs) to fuse or complement across RGB and optical flow cues via simple strategies. To take full advantage of CNNs and recently emerged Transformers, this letter proposes a novel mutual-guidance Transformer-embedding network, called MGT-Net, where a mutual-guidance multi-head attention mechanism (MGMA) explores more sophisticated long-range cross-modal interactions. Such a mechanism is designed into a new mutual-guidance Transformer (MGTrans) module that can propagate long-range contextual dependencies based on information of the other modality. To the best of our knowledge, MGT-Net is the first VSOD model that embeds Transformers as modules into CNNs for improved performance. Prior to MGTrans, we also propose and deploy a feature purification module (FPM) to purify noisy backbone features. Experimental results on five benchmark datasets demonstrate the state-of-the-art performance of MGT-Net.
37
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
Liang-Chieh Chen, George Papandreou, Iasonas Kokkinos et al. · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2017 · 22.1K citations
A Non-Local Algorithm for Image Denoising
Antoni Buades, B. Coll, Jean‐Michel Morel · 2005 · 7.1K citations
Kaiming He, Jian Sun, Xiaoou Tang · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2012 · 5.4K citations