2017 · 378 citations · 32 references
ComputingBiomedical EngineeringBiomedical ImagingComputer VisionDiagnostic ImagingDeep LearningImage FusionImage QualityMedical Image AnalysisMedical ImagingMultimodal ImagingConvolutional Neural Network-based Image FusionConvolutional Neural NetworksDeep Learning-based Image FusionImage PyramidsMedical Data FusionMedical Image FusionMultimodal Image FusionSiamese Networks
Medical image fusion technique plays an an increasingly critical role in many clinical applications by deriving the complementary information from medical images with different modalities. In this paper, a medical image fusion method based on convolutional neural networks (CNNs) is proposed. In our method, a siamese convolutional network is adopted to generate a weight map which integrates the pixel activity information from two source images. The fusion process is conducted in a multi-scale manner via image pyramids to be more consistent with human visual perception. In addition, a local similarity based strategy is applied to adaptively adjust the fusion mode for the decomposed coefficients. Experimental results demonstrate that the proposed method can achieve promising results in terms of both visual quality and objective assessment.
32
Gradient-based learning applied to document recognition
Yann LeCun, Léon Bottou, Yoshua Bengio et al. · Proceedings of the IEEE · 1998 · 58.2K citations · Full text
Yangqing Jia, Evan Shelhamer, Jeff Donahue et al. · 2014 · 11.2K citations
Objective image fusion performance measure
C.S. Xydeas, Vladimir Petrović · Electronics Letters · 2000 · 2K citations
Image Fusion With Guided Filtering
Shutao Li, Xudong Kang, Jianwen Hu · IEEE Transactions on Image Processing · 2013 · 1.8K citations