ComputingComputer EngineeringComputer ScienceAlgorithmsMachine LearningOptimizationClassificationLoss FunctionOptimization For Machine LearningRepresentation LearningBenchmark DatasetsCentroid EstimationCost-sensitive ClassificationCost-sensitive LearningHinge LossLabel Noise MitigationLearningUnlabeled Learning
Positive and Unlabeled learning (PU learning) aims to train a binary classifier based on only positive and unlabeled examples, where the unlabeled examples could be either positive or negative. The state-of-the-art algorithms usually cast PU learning as a cost-sensitive learning problem and impose distinct weights to different training examples via a manual or automatic way. However, such weight adjustment or estimation can be inaccurate and thus often lead to unsatisfactory performance. Therefore, this paper regards all unlabeled examples as negative, which means that some of the original positive data are mistakenly labeled as negative. By doing so, we convert PU learning into the risk minimization problem in the presence of false negative label noise, and propose a novel PU learning algorithm termed ?Loss Decomposition and Centroid Estimation? (LDCE). By decomposing the hinge loss function into two parts, we show that only the second part is influenced by label noise, of which the adverse effect can be reduced by estimating the centroid of negative examples. We intensively validate our approach on synthetic dataset, UCI benchmark datasets and real-world datasets, and the experimental results firmly demonstrate the effectiveness of our approach when compared with other state-of-the-art PU learning methodologies.
15
UCI Repository of machine learning databases
Catherine Blake · Medical Entomology and Zoology · 1998 · 10.5K citations
Learning classifiers from only positive and unlabeled data
Charles Elkan, Keith Noto · 2008 · 1K citations
Building text classifiers using positive and unlabeled examples
Partially Supervised Classification of Text Documents
Bing Liu, Wee Sun Lee, Philip S. Yu et al. · 2002 · 517 citations