Proceedings of the AAAI Conference on Artificial Intelligence · 2017 · 49 citations · 30 references
ComputingComputer ScienceData ScienceData MiningFeature EngineeringMachine LearningClassificationDecision TreesEnsemble LearningRepresentation LearningSemi-supervised LearningSupervised LearningClass ImbalanceClass Imbalance HandlingClass Imbalance LearningImbalanced ClassificationImbalanced LearningMulti-label Text ClassificationSplittingStructured Prediction
The multi-label classification problem involves finding a model that maps a set of input features to more than one output label. Class imbalance is a serious issue in multi-label classification. We introduce an extension of structured forests, a type of random forest used for structured prediction, called Sparse Oblique Structured Hellinger Forests (SOSHF). We explore using structured forests in the general multi-label setting and propose a new imbalance-aware formulation by altering how the splitting functions are learned in two ways. First, we account for cost-sensitivity when converting the multi-label problem to a single-label problem at each node in the tree. Second, we introduce a new objective function for determining oblique splits based on the Hellinger distance, a splitting criterion that has been shown to be robust to class imbalance. We empirically validate our method on a number of benchmarks against standard and state-of-the-art multi-label classification algorithms with improved results.
30
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
SMOTE: Synthetic Minority Over-sampling Technique
Nitesh V. Chawla, Kevin W. Bowyer, Lawrence Hall et al. · Journal of Artificial Intelligence Research · 2002 · 31.2K citations · Full text
J. R. Quinlan · Machine Learning · 1986 · 12.4K citations · Full text
Statistical Comparisons of Classifiers over Multiple Data Sets
Janez Demšar · 2006 · 11.2K citations
ADASYN: Adaptive synthetic sampling approach for imbalanced learning
Haibo He, Yang Bai, Edwardo A. Garcia et al. · 2008 · 4.4K citations