IEEE Geoscience and Remote Sensing Letters · 2020 · 250 citations · 22 references
ComputingComputer ScienceComputer VisionMachine LearningRemote SensingDeep LearningFeature-level FusionHyperspectral ImagingImage ClassificationLidar Remote SensingRemote Sensing Image AnalysisDeep Feature FusionEncoder-decoder ArchitecturesFusion StrategiesHyperspectral ClassificationHyperspectral Image ClassificationMultimodal Input FusionNeural Network Fusion ArchitecturesRemote Sensing Analysis
Deep learning (DL) has been garnering increasing attention in remote sensing (RS) due to its powerful data representation ability. In particular, deep models have been proven to be effective for RS data classification based on a single given modality. However, with one single modality, the ability in identifying the materials remains limited due to the lack of feature diversity. To overcome this limitation, we present a simple but effective multimodal DL baseline by following a deep encoder–decoder network architecture, EndNet for short, for the classification of hyperspectral and light detection and ranging (LiDAR) data. EndNet fuses the multimodal information by enforcing the fused features to reconstruct the multimodal input in turn. Such a reconstruction strategy is capable of better activating the neurons across modalities compared with some conventional and widely used fusion strategies, e.g., early fusion, middle fusion, and late fusion. Extensive experiments conducted on two popular hyperspectral and LiDAR data sets demonstrate the superiority and effectiveness of the proposed EndNet in comparison with several state-of-the-art baselines in the hyperspectral-LiDAR classification task. The codes will be available at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/danfenghong/IEEE_GRSL_EndNet</uri> , contributing to the RS community.
22
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
Graph Convolutional Networks for Hyperspectral Image Classification
Danfeng Hong, Lianru Gao, Jing Yao et al. · IEEE Transactions on Geoscience and Remote Sensing · 2020 · 1.6K citations · Full text