Target Oriented Perceptual Adversarial Fusion Network for Underwater Image Enhancement

Zhiying Jiang, Zhuoxiao Li, Shuzhou Yang, Xin Fan, Risheng Liu

IEEE Transactions on Circuits and Systems for Video Technology · 2022 · 252 citations · 52 references

Concepts

TL;DR

Underwater images are severely degraded by light refraction and absorption, producing color casts, hazy blur, and low visibility that impair marine applications on autonomous underwater vehicles. This study introduces TOPAL, a target‑oriented perceptual adversarial fusion network designed to eliminate such degradation. TOPAL models turbidity and chromatism by combining a multi‑scale dense‑boosted module for contrast, a deep aesthetic render module for color correction, dual channel‑wise attention for adaptive feature fusion, a global‑local adversarial mechanism to align synthetic and real data, and embedded perceptual cues. Experiments on multiple benchmarks show that TOPAL markedly improves underwater image quality and surpasses existing state‑of‑the‑art methods.

Abstract

Due to the refraction and absorption of light by water, underwater images usually suffer from severe degradation, such as color cast, hazy blur, and low visibility, which would degrade the effectiveness of marine applications equipped on autonomous underwater vehicles. To eliminate the degradation of underwater images, we propose a target oriented perceptual adversarial fusion network, dubbed TOPAL. Concretely, we consider the degradation factors of underwater images in terms of turbidity and chromatism. And according to the degradation issues, we first develop a multi-scale dense boosted module to strengthen the visual contrast and a deep aesthetic render module to perform the color correction, respectively. After that, we employ the dual channel-wise attention module and guide the adaptive fusion of latent features, in which both diverse details and credible appearance are integrated. To bridge the gap between synthetic and real-world images, a global-local adversarial mechanism is introduced in the reconstruction. Besides, perceptual information is also embedded into the process to assist the understanding of scenery content. To evaluate the performance of TOPAL, we conduct extensive experiments on several benchmarks and make comparisons among state-of-the-art methods. Quantitative and qualitative results demonstrate that our TOPAL improves the quality of underwater images greatly and achieves superior performance than others.

References

52