Infoscience (Ecole Polytechnique Fédérale de Lausanne) · 2013 · 128 citations · 17 references
Open access
ComputingComputer ScienceAlgorithmsKnowledge TransferMachine LearningBias-variance TradeoffTransfer LearningTransfer Of LearningCross-domain TransferDomain GeneralizationGeneralization ErrorLeave-one-out AnalysisLeave-one-out Cross-validationRegularizationStability Of Learning Algorithms
We consider the transfer learning scenario, where the learner does not have access to the source domain directly, but rather operates on the basis of hypotheses induced from it - the Hypothesis Transfer Learning (HTL) problem. Particularly, we conduct a theoretical analysis of HTL by considering the algorithmic stability of a class of HTL algorithms based on Regularized Least Squares with biased regularization. We show that the relatedness of source and target domains accelerates the convergence of the Leave-One-Out error to the generalization error, thus enabling the use of the Leave-One-Out error to find the optimal transfer parameters, even in the presence of a small training set. In case of unrelated domains we also suggest a theoretically principled way to prevent negative transfer, so that in the limit we recover the performance of the algorithm not using any knowledge from the source domain.
17
Pattern Recognition and Machine Learning
Journal of Electronic Imaging · 2007 · 22.1K citations
A theory of learning from different domains
Shai Ben-David, John Blitzer, Koby Crammer et al. · Machine Learning · 2009 · 3.5K citations · Full text
Applied Physics Letters · 2000 · 705 citations · Full text