IEEE Transactions on Games · 2023 · 17 citations · 37 references
ComputingComputer ScienceComputer VisionMachine LearningSensor FusionDeep LearningFeature-level FusionImage Feature EngineeringImage FusionScene UnderstandingConvolutional Neural Network-based Image FusionDeep Feature FusionDeep Learning-based FusionDeep Learning-based Image FusionImage Feature FusionInfrared Image FusionMultimodal Image FusionVisual Fidelity
Limited by the shooting scenes and angles of fixed cameras, the existing datasets generally lack many detailed pedestrian models in diverse scenarios. Existing deep learning-based image fusion methods, for this reason, bring about overfitting or insufficient information of fusion results in varying degrees. To address this challenge, A new infrared-visible pedestrian synthetic dataset (GIVF) with a synthetic data tagger (GSDT) is constructed and an improved end-to-end image fusion network (FSGAN) is proposed to validate infrared and visible fusion. In the model, the method uses an auxiliary network to extract features that complement the cascade network of the main path, effectively improving the ability to extract pedestrian texture details. Experimental results show that FSGAN can be well applied to GIVF. By conducting extensive comparative experiments with eight state-of-the-art image fusion methods. FSGAN shows better performance than those comparison methods, especially in the two evaluation indexes visual information fidelity (VIF) and structural similarity measurement (SSIM). Besides, by comparing the quantitative analysis results of various methods, and evaluating the fusion results of real images in complex environments on other three datasets, we conclude that FSGAN can be better applied to GIVF datasets than other popular methods, and has outstanding performance in generalization.
37
Image quality assessment: from error visibility to structural similarity
Zhou Wang, Alan C. Bovik, Hamid R. Sheikh et al. · IEEE Transactions on Image Processing · 2004 · 56K citations
Densely Connected Convolutional Networks
Gao Huang, Zhuang Liu, Laurens van der Maaten et al. · 2017 · 44.7K citations
Image registration methods: a survey
Jan Flusser · Image and Vision Computing · 2003 · 6.4K citations
Understanding deep learning (still) requires rethinking generalization
Chiyuan Zhang, Samy Bengio, Moritz Hardt et al. · Communications of the ACM · 2021 · 2.3K citations · Full text
FusionGAN: A generative adversarial network for infrared and visible image fusion
Jiayi Ma, Wei Yu, Pengwei Liang et al. · Information Fusion · 2018 · 2.1K citations