IEEE Journal of Selected Topics in Signal Processing · 2007 · 38 citations · 39 references
ComputingComputer ScienceAlgorithmsMachine LearningOptimizationDigital Signal ProcessingDimensionality ReductionGlobal OptimizationIterative SolversMatrix ComputationSignal ProcessingFixed-point ComputationSparse CodingSparse Signal ProcessingSparse Signal RepresentationVector Space Models
Sparse representations has become an important topic in years. It consists in representing, say, a signal (vector) as a linear combination of as few as possible components (vectors) from a redundant basis (of the vector space). This is usually performed, either iteratively (adding a component at a time), or globally (selecting simultaneously all the needed components). We consider a specific algorithm, that we obtain as a fixed point algorithm, but that can also be seen as an iteratively reweighted least-squares algorithm. We analyze it thoroughly and show that it converges to the global optimum. We detail the proof in the real case and indicate how to extend it to the complex case. We illustrate the result with some easily reproducible toy simulations, that further illustrate the potential tracking properties of the proposed algorithm.
39
David L. Donoho · IEEE Transactions on Information Theory · 2006 · 23.1K citations
Bradley Efron, Trevor Hastie, Iain M. Johnstone et al. · The Annals of Statistics · 2004 · 9.5K citations · Full text