IEEE Transactions on Pattern Analysis and Machine Intelligence · 2006 · 165 citations · 26 references
ComputingComputer ScienceComputational LinguisticsMachine LearningNatural Language ProcessingClassificationDimensionality ReductionMetric LearningNearest Neighbor SearchRepresentation LearningText MiningAutomated Text ClassificationDistance Metric LearningDistance-based ClassificationK-nearest NeighborsMetric Learning For ClassificationNearest-neighbor ClassificationText ClassificationText Classification Features
In order to optimize the accuracy of the Nearest-Neighbor classification rule, a weighted distance is proposed, along with algorithms to automatically learn the corresponding weights. These weights may be specific for each class and feature, for each individual prototype, or for both. The learning algorithms are derived by (approximately) minimizing the Leaving-One-Out classification error of the given training set. The proposed approach is assessed through a series of experiments with UCI/STATLOG corpora, as well as with a more specific task of text classification which entails very sparse data representation and huge dimensionality. In all these experiments, the proposed approach shows a uniformly good behavior, with results comparable to or better than state-of-the-art results published with the same data so far.
26
UCI Repository of Machine Learning Databases
Christopher J. Merz · Medical Entomology and Zoology · 1996 · 2.3K citations
Boosting the margin: a new explanation for the effectiveness of voting methods
Peter L. Bartlett, Yoav Freund, Wee Sun Lee et al. · The Annals of Statistics · 1998 · 2.3K citations · Full text
Craig Stanfill, David L. Waltz · Communications of the ACM · 1986 · 1.2K citations