IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · 2024 · 16 citations · 31 references
ComputingComputer ScienceComputer VisionMachine LearningRemote SensingImage ClassificationInstance SegmentationRemote Sensing Image AnalysisRemote Sensing ImagerySemantic SegmentationInstance Segmentation EvaluationMask PredictionRemote Sensing ApplicationsRemote Sensing SegmentationScene SegmentationSynthetic Aperture Radar
The segment anything model (SAM), a foundational model designed for promptable segmentation tasks, demonstrates exceptional generalization capabilities, making it highly promising for natural scene image segmentation. However, SAM's lack of pretraining on massive remote sensing images and its interactive structure limit its automatic mask prediction capabilities. In this article, a multicognitive SAM-based instance segmentation model (MC-SAM SEG) is introduced to employ SAM on remote sensing domain. The SAM-multicognitive visual adapter (Mona) encoder utilizing the Mona is conducted to facilitate SAM's transfer learning in remote sensing applications. The proposed method named MC-SAM SEG extracts high-quality features by fine-tuning the SAM-Mona encoder along with a feature aggregator. Subsequently, a pixel decoder and transformer decoder are designed for prompt-free mask generation and instance classification. The comprehensive experiments are conducted on the HRSID and WHU datasets for instance segmentation tasks on synthetic aperture radar images and optical remote sensing images, respectively. The evaluation results indicate the proposed method surpasses other deep learning algorithms and verify its effectiveness and generalization.
31
Kaiming He, Georgia Gkioxari, Piotr Dollár et al. · 2017 · 28.8K citations
Alexander M. Kirillov, Eric Mintun, Nikhila Ravi et al. · 2023 · 9.1K citations
Cascade R-CNN: Delving Into High Quality Object Detection
Zhaowei Cai, Nuno Vasconcelos · 2018 · 6.8K citations
Hybrid Task Cascade for Instance Segmentation
Kai Chen, Jiangmiao Pang, Jiaqi Wang et al. · 2019 · 1.5K citations