International Journal of Remote Sensing · 2023 · 10 citations · 28 references
ComputingComputer ScienceEarth SciencesMachine LearningRemote SensingSensor FusionHyperspectral ImagingImage ClassificationLand Cover ClassificationLand Cover MappingRemote Sensing Image AnalysisRemote Sensing ImageryGraph Convolutional NetworksHyperspectral ClassificationHyperspectral Feature ExtractionHyperspectral Image ClassificationMultimodal Feature FusionMultimodal Knowledge GraphsRemote Sensing ClassificationRemote Sensing Image Classification
With the development of remote sensing (RS) technology, single-modal data alone has gradually become difficult to meet the requirement for high accuracy of RS image classification. As a result, multi-modal RS image classification has become a hot research topic. However, multi-modal RS image classification faces challenges in effectively utilizing advanced semantic information regarding the relationships between land cover classes and extracting discriminative features from the data. Based on this, a multi-modal RS image classification method based on knowledge graph (KG) is proposed. Firstly, graph topology is used to align the hyperspectral image (HSI) and multispectral image (MSI) features extracted by graph convolution networks. Constraint alignment is performed on different feature graphs to reduce the difficulty of fusion and the false recognition rate. Then, we use self-attention and cross-attention to purposefully fuse HSI and MSI to obtain discriminative features rich in two modal information and achieve feature weighted fusion. Finally, a KG based on object spatial relationships is constructed to obtain spatial relationships between different classes to assist in multi-modal RS image classification. The experimental results on the Houston and Ausburg datasets demonstrate that the proposed method achieves overall accuracy of 90.40% and 90.85%, respectively, both of which are more than 3% higher than existing classification methods. The results indicate that our method has better classification performance and can provide a useful reference for RS image classification research.
28
Danfeng Hong, Jingliang Hu, Jing Yao et al. · ISPRS Journal of Photogrammetry and Remote Sensing · 2021 · 290 citations · Full text
Deep Fusion of Remote Sensing Data for Accurate Classification
Yushi Chen, Chunyang Li, Pedram Ghamisi et al. · IEEE Geoscience and Remote Sensing Letters · 2017 · 242 citations