IEEE Multimedia · 2021 · 44 citations · 13 references
ComputingComputer ScienceCinematographyComputer VisionVisual PerceptionData CompressionDeep LearningImage CompressionImage QualityLossy Data CompressionVideo AnalysisCodingCoding StandardsCompressionCompression Artifact ReductionConvolutional Neural NetworksPerceptual Quality AssessmentPostprocessing TechniquesVideo Compression
In recent years, video compression techniques have been significantly challenged by the rapidly increased demands associated with high quality and immersive video content. Among various compression tools, postprocessing can be applied on reconstructed video content to mitigate visible compression artefacts and to enhance the overall perceptual quality. Inspired by advances in deep learning, we propose a new convolutional neural network based postprocessing approach, which has been integrated with two state-of-the-art coding standards, versatile video coding (VVC) and AOMedia Video (AV1). The results show consistent coding gains on all tested sequences at various spatial resolutions, with average bit rate savings of 4.0% and 5.8% against original VVC and AV1, respectively (based on the assessment of peak signal-to-noise ratio). This network has also been trained with perceptually inspired loss functions, which have further improved the reconstruction quality based on perceptual quality assessment (VMAF), with average coding gains of 13.9% over VVC and 10.5% against AV1.
13
Image quality assessment: from error visibility to structural similarity
Zhou Wang, Alan C. Bovik, Hamid R. Sheikh et al. · IEEE Transactions on Image Processing · 2004 · 56K citations
Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network
Christian Ledig, Lucas Theis, Ferenc Huszár et al. · 2017 · 12.3K citations
Multiscale structural similarity for image quality assessment
Zhou Wang, Eero P. Simoncelli, Alan C. Bovik · 2004 · 5.9K citations