IEEE Transactions on Neural Networks and Learning Systems · 2018 · 48 citations · 51 references
ComputingComputer ScienceAlgorithmsComputational GeometryComputational MechanicsIterative SolversMatrix ComputationMatrix FactorizationNumerical AlgorithmsNumerical AnalysisNumerical Linear AlgebraAccuracyConvergenceMatrix CompletionQr DecompositionSingular Value DecompositionSparse Matrix AlgorithmsSparse Matrix ComputationSparse Matrix Techniques
Low-rank matrix completion aims to recover matrices with missing entries and has attracted considerable attention from machine learning researchers. Most of the existing methods, such as weighted nuclear-norm-minimization-based methods and Qatar Riyal (QR)-decomposition-based methods, cannot provide both convergence accuracy and convergence speed. To investigate a fast and accurate completion method, an iterative QR-decomposition-based method is proposed for computing an approximate singular value decomposition. This method can compute the largest r(r > 0) singular values of a matrix by iterative QR decomposition. Then, under the framework of matrix trifactorization, a method for computing an approximate SVD based on QR decomposition (CSVDQR)-based L <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2,1</sub> -norm minimization method (LNM-QR) is proposed for fast matrix completion. Theoretical analysis shows that this QR-decomposition-based method can obtain the same optimal solution as a nuclear norm minimization method, i.e., the L <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2,1</sub> -norm of a submatrix can converge to its nuclear norm. Consequently, an LNM-QR-based iteratively reweighted L <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2,1</sub> -norm minimization method (IRLNM-QR) is proposed to improve the accuracy of LNM-QR. Theoretical analysis shows that IRLNM-QR is as accurate as an iteratively reweighted nuclear norm minimization method, which is much more accurate than the traditional QR-decomposition-based matrix completion methods. Experimental results obtained on both synthetic and real-world visual data sets show that our methods are much faster and more accurate than the state-of-the-art methods.
51
Weighted Nuclear Norm Minimization with Application to Image Denoising
Shuhang Gu, Lei Zhang, Wangmeng Zuo et al. · 2014 · 2.3K citations
Natural Sciences, Biomedical Engineering, Computer Vision +15