IEEE Transactions on Neural Networks and Learning Systems · 2016 · 71 citations · 32 references
ComputingComputer ScienceArtificial IntelligenceData MiningMachine LearningClassificationNearest Neighbor SearchNeural NetworksOptimization For Machine LearningPattern RecognitionSupervised LearningK-nearest NeighborsNearest-neighbor ClassificationNeural Network Classification
This paper presents a nearest neighbor partitioning method designed to improve the performance of a neural-network classifier. For neural-network classifiers, usually the number, positions, and labels of centroids are fixed in partition space before training. However, that approach limits the search for potential neural networks during optimization; the quality of a neural network classifier is based on how clear the decision boundaries are between classes. Although attempts have been made to generate floating centroids automatically, these methods still tend to generate sphere-like partitions and cannot produce flexible decision boundaries. We propose the use of nearest neighbor classification in conjunction with a neural-network classifier. Instead of being bound by sphere-like boundaries (such as the case with centroid-based methods), the flexibility of nearest neighbors increases the chance of finding potential neural networks that have arbitrarily shaped boundaries in partition space. Experimental results demonstrate that the proposed method exhibits superior performance on accuracy and average f-measure.
32
Mark Hall, Eibe Frank, Geoffrey Holmes et al. · ACM SIGKDD Explorations Newsletter · 2009 · 17.8K citations
A new optimizer using particle swarm theory
R.C. Eberhart, James Kennedy · 2002 · 14.9K citations
J. R. Quinlan · Machine Learning · 1986 · 14.8K citations · Full text
J. R. Quinlan · Machine Learning · 1986 · 12.4K citations · Full text
Approximation capabilities of multilayer feedforward networks
Kurt Hornik · Neural Networks · 1991 · 6.1K citations