Rare & Special e-Zone (The Hong Kong University of Science and Technology) · 2003 · 148 citations · 11 references
ComputingComputer ScienceMathematicsMachine LearningOptimizationStatistical LearningClassificationKernel MethodsMetric LearningOptimization For Machine LearningPattern RecognitionRepresentation LearningDistance Metric LearningKernel LearningKernel Metric LearningMetric Learning For Classification
The kernel function plays a central role in kernel methods. Existing methods typically fix the functional form of the kernel in advance and then only adapt the associated kernel parameters based on empirical data. In this paper, we consider the problem of adapting the kernel so that it becomes more similar to the so-called ideal kernel. We formulate this as a distance metric learning problem that searches for a suitable linear transform (feature weighting) in the kernel-induced feature space. This formulation is applicable even when the training set can only provide examples of similar and dissimilar pairs, but not explicit class label information. Computationally, this leads to a local-optima-free quadratic programming problem, with the number of variables independent of the number of features. Performance of this method is evaluated on classification and clustering tasks on both toy and real-world data sets.
11
Yuhai Wu, Vladimir Vapnik · Technometrics · 1999 · 27K citations
Nonlinear Dimensionality Reduction by Locally Linear Embedding
Sam T. Roweis, Lawrence K. Saul · Science · 2000 · 15K citations
Bernhard Schölkopf, Alex Smola, Robert C. Williamson et al. · Neural Computation · 2000 · 2.8K citations
Distance Metric Learning with Application to Clustering with Side-Information
Eric P. Xing, Michael I. Jordan, Stuart Russell et al. · 2002 · 2.7K citations
Choosing Multiple Parameters for Support Vector Machines
Olivier Chapelle, Vladimir Vapnik, Olivier Bousquet et al. · Machine Learning · 2002 · 2.2K citations · Full text