IEEE Access · 2020 · 24 citations · 9 references
ComputingComputational EngineeringComputer ScienceComputer VisionMachine LearningMachine VisionDigital Image ProcessingGenerative ModelingImage ProcessingImage SynthesisInfrared Remote SensingThermal Remote SensingGenerative Adversarial NetworksGenerative Image SynthesisSurveillance SystemsSynthetic Image GenerationThermal Infrared Imaging
Thermal infrared (TIR) images are not influenced by the illumination variations and can be used in total darkness. With these advantages, TIR technology has a wide application in surveillance systems and various defense systems. However, there are not enough TIR images for wide range of application because the equipment for thermal infrared imaging is expensive and demands strict imaging conditions. To address this problem, we propose a sparse generative model based on pix2pix framework to produce synthetic TIR data from optical RGB images. Considering little texture and color information in TIR images, this model uses a U-net architecture but only selects partial low-level and high-level information for symmetric connections. Specially, we integrate intensity and gradient losses into the objective to train models, which assists generation models to learn more infrared images' characteristics. The experiments on public datasets prove that this proposed method can generate TIR data from optical images. Compared with current pix2pix networks, this method achieves increases by over 6.5% and over 1.2% separately on the metrics of SSIM and PSNR based on the public datasets. The SSIM value even gets an increase by 7% for daytime images. Meanwhile the network parameters decent by 13%.
9
Image quality assessment: from error visibility to structural similarity
Zhou Wang, Alan C. Bovik, Hamid R. Sheikh et al. · IEEE Transactions on Image Processing · 2004 · 56K citations
Fully convolutional networks for semantic segmentation
Jonathan Long, Evan Shelhamer, Trevor Darrell · 2015 · 36.9K citations
Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks
Jun-Yan Zhu, Taesung Park, Phillip Isola et al. · 2017 · 21.9K citations · Full text
Conditional Generative Adversarial Nets
Mehdi Mirza, Simon Osindero · arXiv (Cornell University) · 2014 · 8.9K citations · Full text