Emerging From Water: Underwater Image Color Correction Based on Weakly Supervised Color Transfer

Unknown author(s)

IEEE Signal Processing Letters · 2018 · 518 citations · 27 references

DOIFull text

Open access

Concepts

TL;DR

Underwater vision is severely degraded by selective attenuation and scattering, impairing image quality and limiting vision task performance. The study aims to address underwater color distortion by proposing a weakly supervised color transfer approach that does not rely on paired images or fixed spectral profiles. The method employs a weakly supervised color transfer network based on Cycle‑Consistent Adversarial Networks, using a multi‑term loss comprising adversarial, cycle‑consistency, and SSIM components to preserve content while correcting color. Experiments on diverse underwater scenes demonstrate that the proposed method yields visually superior results, surpassing state‑of‑the‑art techniques and enhancing downstream vision task performance.

Abstract

Underwater vision suffers from severe effects due to selective attenuation and scattering when light propagates through water. Such degradation not only affects the quality of underwater images but limits the ability of vision tasks. Different from existing methods which either ignore the wavelength dependency of the attenuation or assume a specific spectral profile, we tackle color distortion problem of underwater image from a new view. In this letter, we propose a weakly supervised color transfer method to correct color distortion, which relaxes the need of paired underwater images for training and allows for the underwater images unknown where were taken. Inspired by Cycle-Consistent Adversarial Networks, we design a multi-term loss function including adversarial loss, cycle consistency loss, and SSIM (Structural Similarity Index Measure) loss, which allows the content and structure of the corrected result the same as the input, but the color as if the image was taken without the water. Experiments on underwater images captured under diverse scenes show that our method produces visually pleasing results, even outperforms the art-of-the-state methods. Besides, our method can improve the performance of vision tasks.

References

27