Boltzmann Machine and Mean-Field Approximation for Structured Sparse Decompositions

Angélique Drémeau, Cédric Herzet, Laurent Daudet

IEEE Transactions on Signal Processing · 2012 · 78 citations · 63 references

Concepts

Abstract

Taking advantage of the structures inherent in many sparse decompositions constitutes a promising research axis. In this paper, we address this problem from a Bayesian point of view. We exploit a Boltzmann machine, allowing to take a large variety of structures into account, and focus on the resolution of a marginalized maximum a posteriori problem. To solve this problem, we resort to a mean-field approximation and the “variational Bayes expectation-maximization” algorithm. This approach results in a soft procedure making no hard decision on the support or the values of the sparse representation. We show that this characteristic leads to an improvement of the performance over state-of-the-art algorithms.

References

63