IEEE Transactions on Circuits and Systems for Video Technology · 2022 · 80 citations · 36 references
ComputingComputer ScienceComputer VisionMachine VisionSensor FusionDeep LearningFeature-level FusionImage Feature EngineeringImage FusionDisentangled Representation LearningGenerative Adversarial Network-based Image FusionGenerative Adversarial NetworksInfrared Image FusionMultimodal Image FusionObjective EvaluationRepresentation FusionVisible Image Fusion
This paper proposes a new infrared and visible image fusion method based on the densely connected disentangled representation generative adversarial network (DCDR-GAN), which strips the content and the modal features of infrared and visible images through disentangled representation (DR) and fuses them separately. To deal with the mutually exclusive features in infrared and visible images, inject the modal features into the reconstruction of content features through adaptive instance normalization (AdaIN), reducing the interference. To reduce feature loss and ensure the expression of all-level features in the fused image, DCDR-GAN designs the densely connected content encoders and fusion decoder and constructs the multi-scale fusion structures between the enc-dec through long connections. Meanwhile, the content and the modal reconstruction losses are proposed to preserve the information of the source images. Finally, through the two-phase trained model, generate the fused image. The subjective and objective evaluation results of the TNO and INO datasets show that the proposed method has better visual effects and higher index values than other state-of-the-art methods.
36
Image quality assessment: from error visibility to structural similarity
Zhou Wang, Alan C. Bovik, Hamid R. Sheikh et al. · IEEE Transactions on Image Processing · 2004 · 56K citations
Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks
Jun-Yan Zhu, Taesung Park, Phillip Isola et al. · 2017 · 21.9K citations · Full text
Least Squares Generative Adversarial Networks
Xudong Mao, Qing Li, Haoran Xie et al. · 2017 · 5.2K citations
FusionGAN: A generative adversarial network for infrared and visible image fusion
Jiayi Ma, Wei Yu, Pengwei Liang et al. · Information Fusion · 2018 · 2.1K citations