2014 · 16 citations · 19 references
ComputingCommunicationComputer ScienceComputational LinguisticsDistributed SystemsNatural Language ProcessingDistributed AlgorithmsDistributed ComputingLanguage ModelingLanguage ModelsText RepresentationTopic ModelingExtreme PointsScalable Topic ModelingSolid Angle
Topic modeling for large-scale distributed web-collections requires distributed tech-niques that account for both computational and communication costs. We consider topic modeling under the separability assumption and develop novel computationally efficient methods that provably achieve the statisti-cal performance of the state-of-the-art cen-tralized approaches while requiring insignifi-cant communication between the distributed document collections. We achieve trade-offs between communication and computa-tion without actually transmitting the doc-uments. Our scheme is based on exploiting the geometry of normalized word-word co-occurrence matrix and viewing each row of this matrix as a vector in a high-dimensional space. We relate the solid angle subtended by extreme points of the convex hull of these vectors to topic identities and construct dis-tributed schemes to identify topics. 1
19
UCI Machine Learning Repository
Arthur Asuncion · Medical Entomology and Zoology · 2007 · 24.4K citations
David M. Blei · Communications of the ACM · 2012 · 5.5K citations