IEEE Transactions on Pattern Analysis and Machine Intelligence · 2004 · 132 citations · 23 references
ComputingComputer ScienceData MiningFeature EngineeringMachine LearningClassificationDimension ReductionFeature ExtractionFeature SelectionPattern RecognitionPolynomial FeaturesBiometric Feature ExtractionBiometric FusionClassification AccuracyClassification Accuracy AnalysisClassification Accuracy AssessmentFusion Decision MakingMachine Learning-based ClassificationPolynomial Regression
A novel method using a reduced multivariate polynomial model has been developed for biometric decision fusion where simplicity and ease of use could be a concern. However, much to our surprise, the reduced model was found to have good classification accuracy for several commonly used data sets from the Web. In this paper, we extend the single output model to a multiple outputs model to handle multiple class problems. The method is particularly suitable for problems with small number of features and large number of examples. Basic component of this polynomial model boils down to construction of new pattern features which are sums of the original features and combination of these new and original features using power and product terms. A linear regularized least-squares predictor is then built using these constructed features. The number of constructed feature terms varies linearly with the order of the polynomial, instead of having a power law in the case of full multivariate polynomials. The method is simple as it amounts to only a few lines of Matlab code. We perform extensive experiments on this reduced model using 42 data sets. Our results compared remarkably well with best reported results of several commonly used algorithms from the literature. Both the classification accuracy and efficiency aspects are reported for this reduced model.
23
Multilayer feedforward networks are universal approximators
Kurt Hornik, Maxwell B. Stinchcombe, Halbert White · Neural Networks · 1989 · 21.2K citations
Neural networks for pattern recognition
Choice Reviews Online · 1994 · 18.7K citations
A training algorithm for optimal margin classifiers
Bernhard E. Boser, Isabelle Guyon, Vladimir Vapnik · 1992 · 11.6K citations
UCI Repository of machine learning databases
Catherine Blake · Medical Entomology and Zoology · 1998 · 10.5K citations