2009 · 47 citations · 9 references
ComputingComputer ScienceMathematicsComputer VisionFeature EngineeringMachine LearningDigital Image ProcessingDimensionality ReductionImage ProcessingKernel MethodsPattern RecognitionRepresentation LearningHilbert Space RepresentationsLearning KernelsMultidimensional ScalingReproducing Kernel Hilbert Spaces
In this paper, we consider the pre-image problem in kernel machines, such as denoising with kernel-PCA. For a given reproducing kernel Hilbert space (RKHS), by solving the pre-image problem one seeks a pattern whose image in the RKHS is approximately a given feature. Traditional techniques include an iterative technique (Mika et al.) and a multidimensional scaling (MDS) approach (Kwok et al.). In this paper, we propose a new technique to learn the pre-image. In the RKHS, we construct a basis having an isometry with the input space, with respect to a training data. Then representing any feature in this basis gives us information regarding its pre-image in the input space. We show that doing a pre-image can be done directly using the kernel values, without having to compute distances in any of the spaces as with the MDS approach. Simulation results illustrates the relevance of the proposed method, as we compare it to these techniques.
9
Yuhai Wu, Vladimir Vapnik · Technometrics · 1999 · 27K citations
N. Aronszajn · Transactions of the American Mathematical Society · 1950 · 5.4K citations · Full text
1998 · 2.2K citations