IEEE Transactions on Cybernetics · 2014 · 239 citations · 28 references
ComputingComputer ScienceData MiningMachine LearningOptimizationNeural NetworksPattern RecognitionRepresentation LearningSupport Vector MachinesFeedforward Neural NetworksLarge-scale ClassificationLeast Squares Support Vector MachinesSparse LearningSparse Support Vector MachinesSvmsTrainingTraining Time
Extreme learning machine (ELM) was initially proposed for single-hidden-layer feedforward neural networks (SLFNs). In the hidden layer (feature mapping), nodes are randomly generated independently of training data. Furthermore, a unified ELM was proposed, providing a single framework to simplify and unify different learning methods, such as SLFNs, least square support vector machines, proximal support vector machines, and so on. However, the solution of unified ELM is dense, and thus, usually plenty of storage space and testing time are required for large-scale applications. In this paper, a sparse ELM is proposed as an alternative solution for classification, reducing storage space and testing time. In addition, unified ELM obtains the solution by matrix inversion, whose computational complexity is between quadratic and cubic with respect to the training size. It still requires plenty of training time for large-scale problems, even though it is much faster than many other traditional methods. In this paper, an efficient training algorithm is specifically developed for sparse ELM. The quadratic programming problem involved in sparse ELM is divided into a series of smallest possible sub-problems, each of which are solved analytically. Compared with SVM, sparse ELM obtains better generalization performance with much faster training speed. Compared with unified ELM, sparse ELM achieves similar generalization performance for binary classification applications, and when dealing with large-scale binary classification problems, sparse ELM realizes even faster training speed than unified ELM.
28
Corinna Cortes, Vladimir Vapnik · Machine Learning · 1995 · 40.5K citations · Full text
Learning representations by back-propagating errors
David E. Rumelhart, Geoffrey E. Hinton, Ronald J. Williams · Nature · 1986 · 30.9K citations
UCI Machine Learning Repository
Arthur Asuncion · Medical Entomology and Zoology · 2007 · 24.4K citations
Extreme learning machine: Theory and applications
Guang-Bin Huang, Qinyu Zhu, Chee‐Kheong Siew · Neurocomputing · 2006 · 13.2K citations
A tutorial on support vector regression
Alex Smola, Bernhard Schölkopf · Statistics and Computing · 2004 · 13K citations