IEEE Transactions on Signal Processing · 2017 · 189 citations · 40 references
ComputingComputer ScienceMachine LearningStatistical LearningTime Series AnalysisKernel MethodsLoss FunctionOptimization For Machine LearningRobust StatisticsAccuracyGradient Method OptimizationHigher-order StatisticsKernel LearningMean Square ConvergenceRobust Loss Functions
Nonlinear similarity measures defined in kernel space, such as correntropy, can extract higher order statistics of data and offer potentially significant performance improvement over their linear counterparts especially in non Gaussian signal processing and machine learning. In this paper, we propose a new similarity measure in kernel space, called the kernel risk-sensitive loss (KRSL), and provide some important properties. We apply the KRSL to adaptive filtering and investigate the robustness, and then develop the MKRSL algorithm and analyze the mean square convergence performance. Compared with correntropy, the KRSL can offer a more efficient performance surface, thereby enabling a gradient-based method to achieve faster convergence speed and higher accuracy while still maintaining the robustness to outliers. Theoretical analysis results and superior performance of the new algorithm are confirmed by simulation.
40
Robust Face Recognition via Sparse Representation
John Wright, A. Yang, Arvind Ganesh et al. · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2009 · 9.5K citations · Full text