2005 · 67 citations · 23 references
ComputingComputer ScienceComputational LinguisticsMachine LearningNatural Language ProcessingClassificationKernel MethodsRiemannian GeometrySupervised LearningSupport Vector MachinesText MiningFisher InformationGeodesic StructureManifold LearningRiemannian MetricSupport Vector ClassificationSvmsText Classification
Support Vector Machines (SVMs) have been very successful in text classification. However, the intrinsic geometric structure of text data has been ignored by standard kernels commonly used in SVMs. It is natural to assume that the documents are on the multinomial manifold, which is the simplex of multinomial models furnished with the Riemannian structure induced by the Fisher information metric. We prove that the Negative Geodesic Distance (NGD) on the multinomial manifold is conditionally positive definite (cpd), thus can be used as a kernel in SVMs. Experiments show the NGD kernel on the multinomial manifold to be effective for text classification, significantly outperforming standard kernels on the ambient Euclidean space.
23
Chih-Chung Chang, Chih‐Jen Lin · ACM Transactions on Intelligent Systems and Technology · 2011 · 41.3K citations
Nonlinear Dimensionality Reduction by Locally Linear Embedding
Sam T. Roweis, Lawrence K. Saul · Science · 2000 · 15K citations
A Global Geometric Framework for Nonlinear Dimensionality Reduction
Joshua B. Tenenbaum, Vin de Silva, John Langford · Science · 2000 · 13.7K citations
Information theory and statistics
Journal of the Franklin Institute · 1959 · 7.2K citations
A re-examination of text categorization methods
Yiming Yang, Xin Liu · 1999 · 2.7K citations · Full text