Infrared Physics & Technology · 2024 · 15 citations · 67 references
ComputingComputer ScienceComputer VisionMachine LearningMachine VisionAttention NetworksDeep LearningGenerative ModelingImage ClassificationImage FusionRadiative Heat TransferAttention-based FusionAttention-based Image FusionGenerative Adversarial Network-based Image FusionGenerative Adversarial NetworksImage Data FusionInfrared Image FusionThermal RadiationThermal Radiation Effects
Infrared and visible image fusion (IVIF) aims to preserve thermal radiation information from infrared images while integrating texture details from visible images. Thermal radiation information is mainly expressed through image intensities, while texture details are typically expressed through image gradients. However, existing dual-discriminator generative adversarial networks (GANs) often rely on two structurally identical discriminators for learning, which do not fully account for the distinct learning needs of infrared and visible image information. To this end, this paper proposes a novel GAN with a heterogeneous dual-discriminator network and an attention-based fusion strategy (GAN-HA). Specifically, recognizing the intrinsic differences between infrared and visible images, we propose, for the first time, a novel heterogeneous dual-discriminator network to simultaneously capture thermal radiation information and texture details. The two discriminators in this network are structurally different, including a salient discriminator for infrared images and a detailed discriminator for visible images. They are able to learn rich image intensity information and image gradient information , respectively. In addition, a new attention-based fusion strategy is designed in the generator to appropriately emphasize the learned information from different source images, thereby improving the information representation ability of the fusion result. In this way, the fused images generated by GAN-HA can more effectively maintain both the salience of thermal targets and the sharpness of textures. Extensive experiments on various public datasets demonstrate the superiority of GAN-HA over other state-of-the-art (SOTA) algorithms while showcasing its higher potential for practical applications.
67
ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks
Qilong Wang, Banggu Wu, Pengfei Zhu et al. · 2020 · 8.1K citations
A universal image quality index
Zhou Wang, Alan C. Bovik · IEEE Signal Processing Letters · 2002 · 5.7K citations
Deep Learning for Generic Object Detection: A Survey
Li Liu, Wanli Ouyang, Xiaogang Wang et al. · International Journal of Computer Vision · 2019 · 2.8K citations · Full text
FusionGAN: A generative adversarial network for infrared and visible image fusion
Jiayi Ma, Wei Yu, Pengwei Liang et al. · Information Fusion · 2018 · 2.1K citations