2013 · 39 citations · 25 references
ComputingData ScienceBayesian Data AnalysisMachine LearningStatistical LearningBayesian InferenceBayesian StatisticsMatrix FactorizationMaximum Likelihood EstimationSignal ProcessingVariational InferenceBayesian Variational InferencePosterior InferenceSound Source SeparationTensor FactorizationVariational BayesVariational Bayesian FilteringVariational Bayesian InferenceVariational Inference For Nonparametric Models
This paper presents a new class of tensor fac-torization called positive semidefinite tensor factorization (PSDTF) that decomposes a set of positive semidefinite (PSD) matrices into the convex combinations of fewer PSD basis matrices. PSDTF can be viewed as a natu-ral extension of nonnegative matrix factoriza-tion. One of the main problems of PSDTF is that an appropriate number of bases should be given in advance. To solve this problem, we propose a nonparametric Bayesian model based on a gamma process that can instanti-ate only a limited number of necessary bases from the infinitely many bases assumed to exist. We derive a variational Bayesian algo-rithm for closed-form posterior inference and a multiplicative update rule for maximum-likelihood estimation. We evaluated PSDTF on both synthetic data and real music record-ings to show its superiority. 1.
25
On Information and Sufficiency
S. Kullback, R. A. Leibler · The Annals of Mathematical Statistics · 1951 · 20K citations · Full text
Algorithms for Non-negative Matrix Factorization
Daniel D. Lee, H. Sebastian Seung · 2000 · 5.5K citations
Some Mathematical Notes on Three-Mode Factor Analysis
Ledyard R Tucker · Psychometrika · 1966 · 4.3K citations