2020 · 26 citations · 13 references
ComputingComputer ScienceComputer VisionFeature EngineeringMachine LearningData CompressionDeep LearningImage CompressionMotion EstimationOptical FlowVideo AnalysisCompressionEnd-to-end Learned CompressionImage Feature ExtractionImage Feature RepresentationModel CompressionMotion CompensationTrainingVideo Compression
In this paper, we present an end-to-end video compression network for P-frame challenge on CLIC. We focus on deep neural network (DNN) based video compression, and improve the current frameworks from three aspects. First, we notice that pixel space residuals is sensitive to the prediction errors of optical flow based motion compensation. To suppress the relative influence, we propose to compress the residuals of image feature rather than the residuals of image pixels. Furthermore, we combine the advantages of both pixel-level and feature-level residual compression methods by model ensembling. Finally, we propose a step-by-step training strategy to improve the training efficiency of the whole framework. Experiment results indicate that our proposed method achieves 0.9968 MS-SSIM on CLIC validation set and 0.9967 MS-SSIM on test set.
13
PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volume
Deqing Sun, Xiaodong Yang, Ming-Yu Liu et al. · 2018 · 2.7K citations
Video Enhancement with Task-Oriented Flow
Jiajun Wu · International Journal of Computer Vision · 2019 · 1.3K citations · Full text
Variational image compression with a scale hyperprior
Johannes Ballé, David Minnen, Saurabh Singh et al. · arXiv (Cornell University) · 2018 · 1.1K citations · Full text
End-to-end Optimized Image Compression
Johannes Ballé, Valero Laparra, Eero P. Simoncelli · arXiv (Cornell University) · 2016 · 1K citations · Full text