Bayesian Non-Negative Matrix Factorization With Adaptive Sparsity and Smoothness Prior

Abstract

Non-negative matrix factorization (NMF) is generally an ill-posed problem which requires further regularization. Regularization of NMF using the assumption of sparsity is common as well as regularization using smoothness. In many applications it is natural to assume that both of these assumptions hold together. To avoid <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">ad hoc</i> combination of these assumptions using weighting coefficient, we formulate the problem using a probabilistic model and estimate it in a Bayesian way. Specifically, we use the fact that the assumptions of sparsity and smoothness are different forms of prior covariance matrix modeling. We use a generalized model that includes both sparsity and smoothness as special cases and estimate all its parameters using the variational Bayes method. The resulting matrix factorization algorithm is compared with state-of-the-art algorithms on large clinical dataset of 196 image sequences from dynamic renal scintigraphy. The proposed algorithm outperforms other algorithms in statistical evaluation.