2005 · 23 citations · 16 references
ComputingComputer ScienceMachine LearningOptimizationStatistical LearningDimension ReductionDimensionality ReductionKernel MethodsLarge-scale OptimizationOptimization For Machine LearningSupport Vector MachinesKernel ApproximationLarge-scale Support Vector MachinesLeast Squares ProblemsLeast Squares Support Vector MachinesOptimization For High-dimensional DataPartial Least Squares RegressionSparse Support Vector Machines
Kernel based methods suffer from exceeding time and memory requirements when applied on large datasets since the involved optimization problems typically scale polynomially in the number of data samples. As a remedy we propose both working on a reduced set (for fast evaluation) and at the same time keeping the number of model parameters small (for fast training). Departing from the Nystrom based feature approximation we describe fixed-size least squares support vector machine in the context of primal space least squares regression, to extend it with a supervised counterpart, sparse kernel partial least squares. The model is illustrated on a large scale example.
16
UCI Repository of machine learning databases
Catherine Blake · Medical Entomology and Zoology · 1998 · 10.5K citations
N. Aronszajn · Transactions of the American Mathematical Society · 1950 · 5.4K citations · Full text
Using the Nyström Method to Speed Up Kernel Machines
Christopher K. I. Williams, Matthias Seeger · 2000 · 1.5K citations