2009 · 360 citations · 47 references
ComputingComputer ScienceData AnalyticsData MiningMachine LearningDensity EstimationOutlier DetectionApproximation ErrorConvergence Rate AnalysisCovariate ShiftImportance MeasuresImportance ScoringLeave-one-out Cross-validationLeave-one-out ValidationProbability Density Functions
We address the problem of estimating the ratio of two probability density functions, which is often referred to as the importance. The importance values can be used for various succeeding tasks such as covariate shift adaptation or outlier detection. In this paper, we propose a new importance estimation method that has a closed-form solution; the leave-one-out cross-validation score can also be computed analytically. Therefore, the proposed method is computationally highly efficient and simple to implement. We also elucidate theoretical properties of the proposed method such as the convergence rate and approximation error bounds. Numerical experiments show that the proposed method is comparable to the best existing method in accuracy, while it is computationally more efficient than competing approaches.
47
Sample Selection Bias as a Specification Error
James J. Heckman · Econometrica · 1979 · 28.9K citations
Yuhai Wu, Vladimir Vapnik · Technometrics · 1999 · 27K citations
Reinforcement Learning: An Introduction
IEEE Transactions on Neural Networks · 2005 · 25.8K citations