Communications on Pure and Applied Mathematics · 2006 · 2.5K citations · 23 references
ComputingComputer ScienceMathematicsAlgorithmsRepresentation TheoryTheory Of ComputationDimensionality ReductionEigenvalue ProblemsMatrix ComputationGreedy ApproximationGreedy HeuristicsLeast Squares ProblemsMinimizationSparse Inverse ProblemsSparse Linear AlgebraSparse Matrix AlgorithmsSparse Matrix Computation
The authors aim to determine whether the unique ℓ1‑minimizing solution of an underdetermined linear system y = Φx is also the sparsest possible solution. They analyze random Φ with unit‑norm columns under a uniform distribution, employing random proportional embeddings, almost‑spherical sections, and eigenvalue deviation bounds for Wishart matrices. They prove that for large n and almost all Φ, any y that admits a representation with fewer than ρ(τ)·n nonzeros has a unique ℓ1‑minimizer equal to that sparse vector, while greedy and thresholding methods fail in this regime. © 2006 Wiley Periodicals, Inc.
Abstract We consider linear equations y = Φ x where y is a given vector in ℝ n and Φ is a given n × m matrix with n < m ≤ τ n , and we wish to solve for x ∈ ℝ m . We suppose that the columns of Φ are normalized to the unit 𝓁 2 ‐norm, and we place uniform measure on such Φ. We prove the existence of ρ = ρ(τ) > 0 so that for large n and for all Φ's except a negligible fraction, the following property holds: For every y having a representation y = Φ x 0 by a coefficient vector x 0 ∈ ℝ m with fewer than ρ · n nonzeros, the solution x 1 of the 𝓁 1 ‐minimization problem is unique and equal to x 0 . In contrast, heuristic attempts to sparsely solve such systems—greedy algorithms and thresholding—perform poorly in this challenging setting. The techniques include the use of random proportional embeddings and almost‐spherical sections in Banach space theory, and deviation bounds for the eigenvalues of random Wishart matrices. © 2006 Wiley Periodicals, Inc.
23
Stéphane Crépey, Olivier Guéant, David Hobson et al. · HAL (Le Centre pour la Communication Scientifique Directe) · 2011 · 10.2K citations