IEEE Transactions on Neural Networks and Learning Systems · 2013 · 195 citations · 13 references
ComputingComputer ScienceAlgorithmsMachine LearningOptimizationComputational MathematicsComputational StatisticsDigital Signal ProcessingMonte Carlo MethodsOptimization For Machine LearningSignal ProcessingFeature QuantizationKernel RegressionQuantizationRecursive Algorithm DesignVector Quantization
In a recent paper, we developed a novel quantized kernel least mean square algorithm, in which the input space is quantized (partitioned into smaller regions) and the network size is upper bounded by the quantization codebook size (number of the regions). In this paper, we propose the quantized kernel least squares regression, and derive the optimal solution. By incorporating a simple online vector quantization method, we derive a recursive algorithm to update the solution, namely the quantized kernel recursive least squares algorithm. The good performance of the new algorithm is demonstrated by Monte Carlo simulations.
13
A Resource-Allocating Network for Function Interpolation
John Platt · Neural Computation · 1991 · 1.4K citations
Regularization Theory and Neural Networks Architectures
Federico Girosi, Michael Jones, Tomaso Poggio · Neural Computation · 1995 · 1.4K citations
The Kernel Recursive Least-Squares Algorithm
Yaakov Engel, Shie Mannor, Ron Meir · IEEE Transactions on Signal Processing · 2004 · 1.1K citations
Jyrki Kivinen, Alex Smola, Robert C. Williamson · IEEE Transactions on Signal Processing · 2004 · 1K citations