arXiv (Cornell University) · 2013 · 14 citations · 5 references
ComputingComputer ScienceMathematicsMachine LearningProbability TheoryStochastic ProcessesBayesian InferenceBayesian LearningBayesian ModelingBayesian StatisticsHidden Markov ModelsProbabilistic Machine LearningBayesian Hidden Markov ModelsBayesian Nonparametric ModelsCategorical SemanticsClosed CategoriesInference In Hidden Markov ModelsMeasurable SpacesModel Categories
From the Bayesian perspective, the category of conditional probabilities (a variant of the Kleisli category of the Giry monad, whose objects are measurable spaces and arrows are Markov kernels) gives a nice framework for conceptualization and analysis of many aspects of machine learning. Using categorical methods, we construct models for parametric and nonparametric Bayesian reasoning on function spaces, thus providing a basis for the supervised learning problem. In particular, stochastic processes are arrows to these function spaces which serve as prior probabilities. The resulting inference maps can often be analytically constructed in this symmetric monoidal weakly closed category. We also show how to view general stochastic processes using functor categories and demonstrate the Kalman filter as an archetype for the hidden Markov model.
5
A Categorical Foundation for Bayesian Probability
Jared Culbertson, Kirk Sturtz · 2016 · 34 citations
A presentation of the category of stochastic matrices
T. A. Fritz · ArXiv.org · 2009 · 16 citations · Full text