IEEE Transactions on Knowledge and Data Engineering · 2021 · 10 citations · 42 references
ComputingComputer ScienceKnowledge RepresentationMachine LearningNatural Language ProcessingBayesian InferenceBayesian LearningBayesian Model BuildingBayesian ModelingBayesian StatisticsData ModelingData Stream ModelPrior Related KnowledgeStream MiningStreaming LearningStreaming Machine Learning
We consider how to effectively use prior knowledge when learning a Bayesian model from streaming environments where the data come endlessly and sequentially. This problem is highly important in the era of data explosion and rich sources of valuable external knowledge such as pre-trained models, ontologies, Wikipedia, etc. We show that some existing approaches can forget any knowledge very fast. We then propose a novel framework that enables to incorporate the prior knowledge of different forms into a base Bayesian model for data streams. Our framework subsumes some existing popular models for time-series/dynamic data. Extensive experiments show that our framework outperforms existing methods with a large margin. In particular, our framework can help Bayesian models generalize well on extremely short text while other methods overfit. An implementation of our framework is available at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">http://github.com/bachtranxuan/TPS</uri> .
42
Distributed Representations of Words and Phrases and their Compositionality
Tomáš Mikolov, Ilya Sutskever, Kai Chen et al. · arXiv (Cornell University) · 2013 · 18.1K citations · Full text
Translating embeddings for modeling multi-relational data
Antoine Bordes, Nicolas Usunier, Jason Weston et al. · 2015 · 5.2K citations · Full text