IEEE Transactions on Geoscience and Remote Sensing · 2023 · 33 citations · 54 references
ComputingComputer ScienceComputer VisionMachine LearningRemote SensingAttention NetworksDeep LearningHyperspectral ImagingImage ClassificationRemote Sensing Image AnalysisRepresentation LearningAdaptive FusionConvolutional Neural NetworksFeature FusionHyperspectral Data FusionHyperspectral Image ClassificationHyperspectral Image ProcessingImage Feature FusionTransformer Models
In recent years, convolutional neural networks (CNNs) have been extensively used in hyperspectral image (HSI) classification tasks and achieved desirable performance. However, CNNs expand the receptive field by stacking convolutional layers and pooling layers, but the actual receptive field is still insufficient, so it is hard to capture the global representations of HSIs. In addition, the existing CNN models used for HSI classification have low-computational efficiency, and cannot effectively fuse spectral and spatial information. To alleviate the above limitations, this article proposes a novel efficient lightweight spectral–spatial transformer (ELS2T) specially designed for HSI classification. The transformer model can model the long-distance feature dependencies in the HSI cube. First, we design a global multiscale attention module (GMAM) to effectively highlight the useful information and weaken the useless information. Second, considering the different importance of spectral and spatial information for classification tasks, an adaptive feature fusion module (AFFM) is proposed to adaptively fuse the acquired spectral and spatial information. Finally, to improve the computational efficiency, we design the lightweight separable spatial–spectral self-attention ( <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\text{S}^{3}\text{A}$ </tex-math></inline-formula> ) module to replace the multihead self-attention (MHSA) module in the transformer encoder. Experimental results on the four well-known hyperspectral datasets show that our model is superior to the other state-of-the-art deep learning (DL) methods in both computational efficiency and classification performance.
54
DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · 2023 · 76.3K citations · Full text
Squeeze-and-Excitation Networks
Jie Hu, Li Shen, Samuel Albanie et al. · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2019 · 12.5K citations