2023 · 19 citations · 49 references
ComputingComputer ScienceVision ScienceComputer VisionMachine LearningVisual PerceptionDeep LearningFeature-level FusionImage Feature EngineeringImage FusionAdaptive FiltersDeep Learning-based Image FusionDynamic FusionImage Feature FusionInformation Loss AnalysisModel CapacityMulti-exposure Image FusionVisual Performance
Multi exposure image fusion (MEF) aims to produce images with a high dynamic range of visual perception by integrating complementary information from different exposure levels, bypassing common sensors’ physical limits. Despite the marvelous progress made by deep learning-based methods, few considerations have been given to the innovation of fusion paradigms, leading to insufficient model capacity utilization. This paper proposes a novel filter prediction-dominated fusion paradigm toward a simple yet effective MEF. Precisely, we predict a series of spatial-adaptive filters conditioned on the hierarchically represented features to perform an image-level dynamic fusion. The proposed paradigm has the following merits over the previous: 1) it circumvents the risk of information loss arising from the implicit encoding and decoding processes within the neural network, and 2) it better integrates local information to obtain better continuous spatial representations than the weight map-based paradigm. Furthermore, we propose a Gradient-driven Image Fidelity (GIF) loss for unsupervised MEF. Empowered by the exploitation of informative property in the gradient domain, GIF is able to implement a stable distortion-free optimization process. Experimental results demonstrate that our method achieves the best visual performance compared to the state-of-the-art while achieving an almost 30% improvement in inference time. The code is available at https://github.com/keviner1/FFMEF.
49
Microsoft COCO: Common Objects in Context
arXiv (Cornell University) · 2014 · 2.4K citations · Full text
Objective image fusion performance measure
C.S. Xydeas, Vladimir Petrović · Electronics Letters · 2000 · 2K citations
IFCNN: A general image fusion framework based on convolutional neural network
Yu Zhang, Yü Liu, Peng Sun et al. · Information Fusion · 2019 · 1.4K citations