2009 · 202 citations · 25 references
ComputingComputer ScienceFeature EngineeringMachine LearningOptimizationConvex OptimizationGlobal OptimizationLarge-scale OptimizationMulti-task LearningOptimization For Machine LearningRepresentation LearningConvex RelaxationsMulti-task Feature LearningMulti-task Neural NetworksMultitask LearningShared Representation LearningSparse Feature Representation
Multi-task learning (MTL) aims to improve generalization performance by learning multiple related tasks simultaneously. In this paper, we consider the problem of learning shared structures from multiple related tasks. We present an improved formulation (iASO) for multi-task learning based on the non-convex alternating structure optimization (ASO) algorithm, in which all tasks are related by a shared feature representation. We convert iASO, a non-convex formulation, into a relaxed convex one, which is, however, not scalable to large data sets due to its complex constraints. We propose an alternating optimization (cASO) algorithm which solves the convex relaxation efficiently, and further show that cASO converges to a global optimum. In addition, we present a theoretical condition, under which cASO can find a globally optimal solution to iASO. Experiments on several benchmark data sets confirm our theoretical analysis. 1.
25
Chih-Chung Chang, Chih‐Jen Lin · ACM Transactions on Intelligent Systems and Technology · 2011 · 41.3K citations
Libsvm : A library for support vector machines
Vittorio Ferrari · Medical Entomology and Zoology · 2008 · 10.1K citations
Rich Caruana · Machine Learning · 1997 · 6.3K citations · Full text
RCV1: A New Benchmark Collection for Text Categorization Research
David Lewis, Yiming Yang, Tony Rose et al. · Goldsmiths (University of London) · 2004 · 2.6K citations · Full text
Convex multi-task feature learning
Andreas A. Argyriou, Theodoros Evgeniou, Massimiliano Pontil · Machine Learning · 2008 · 1.4K citations · Full text