SIAM Journal on Scientific Computing · 2015 · 476 citations · 59 references
Natural SciencesComputer ScienceMathematicsAlgorithmsDiagnostic ImagingOptimizationConstrained OptimizationConvex OptimizationData MinimizationImage ReconstructionIterative SolversMagnetic Resonance Image ReconstructionAlmost Sure ConvergenceAnnealingCompressed SensingCompressed Sensing Magnetic Resonance ImagingCompressive SensingConvex FunctionsSparse ReconstructionSparse Signal Processing
We study minimization of the difference of $\ell_1$ and $\ell_2$ norms as a nonconvex and Lipschitz continuous metric for solving constrained and unconstrained compressed sensing problems. We establish exact (stable) sparse recovery results under a restricted isometry property (RIP) condition for the constrained problem, and a full-rank theorem of the sensing matrix restricted to the support of the sparse solution. We present an iterative method for $\ell_{1-2}$ minimization based on the difference of convex functions algorithm and prove that it converges to a stationary point satisfying the first-order optimality condition. We propose a sparsity oriented simulated annealing procedure with non-Gaussian random perturbation and prove the almost sure convergence of the combined algorithm (DCASA) to a global minimum. Computation examples on success rates of sparse solution recovery show that if the sensing matrix is ill-conditioned (non RIP satisfying), then our method is better than existing nonconvex compressed sensing solvers in the literature. Likewise in the magnetic resonance imaging (MRI) phantom image recovery problem, $\ell_{1-2}$ succeeds with eight projections. Irrespective of the conditioning of the sensing matrix, $\ell_{1-2}$ is better than $\ell_1$ in both the sparse signal and the MRI phantom image recovery problems.
59
Optimization by Simulated Annealing
Scott Kirkpatrick, C. D. Gelatt, M.P. Vecchi · Science · 1983 · 44.6K citations
David L. Donoho · IEEE Transactions on Information Theory · 2006 · 23.1K citations