IEEE Transactions on Geoscience and Remote Sensing · 2021 · 42 citations · 39 references
ComputingComputer ScienceComputer VisionRemote SensingVisual PerceptionAttention NetworksDeep LearningRemote Sensing Image AnalysisRemote Sensing ImageryAttention-based FusionAttention-based Image FusionContextual DependenciesConvolutionConvolutional Neural NetworksQuality AssessmentResidual NetworksTraining
Remote sensing images often contain many similar components, such as buildings, roads, and water surfaces, which have similar spectra and spatial structures. Although convolutional neural networks (CNNs) based on residual learning can provide excellent performance in pansharpening, the existing methods do not make full use of intrinsically similar information in images. Moreover, since the convolution operation is focused on the local region, even in a deep network, position-independent global information is difficult to obtain. In this article, an efficient nonlocal attention residual network (NLRNet) is proposed to capture the similar contextual dependencies of all pixels. Specifically, to reduce the difficulty of network training caused by the original nonlocal attention, we propose an efficient nonlocal attention (ENLA) mechanism and employ residual with zero initialization (ReZero) technology to make the signal easy to spread through the network. Furthermore, a spectral aggregation module (SpecAM) is proposed to generate fused images and adjust the corresponding spectral information. The experimental results for the QuickBird and WorldView3 data sets show that the proposed method is competitive with other advanced methods based on quality assessment and visual perception.
39
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
Xiaolong Wang, Ross Girshick, Abhinav Gupta et al. · 2018 · 11.2K citations
ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks
Qilong Wang, Banggu Wu, Pengfei Zhu et al. · 2020 · 8.1K citations
CCNet: Criss-Cross Attention for Semantic Segmentation
Zilong Huang, Xinggang Wang, Lichao Huang et al. · 2019 · 2.9K citations