Monash University Research Portal (Monash University) · 2013 · 171 citations · 35 references
ComputingComputer ScienceArtificial IntelligenceMachine LearningStatistical LearningBayesian LearningClassificationEnsemble LearningEnsemble MethodsOptimization For Machine LearningProbabilistic Machine LearningAttributesClassification AlgorithmsConditional IndependenceConditional Independence AssumptionLogistic RegressionNaive BayesNaive Bayes ClassificationNegative Log-likelihood
Despite the simplicity of the Naive Bayes classifier, it has continued to perform well against more sophisticated newcomers and has remained, therefore, of great interest to the machine learning community. Of numerous approaches to refining the naive Bayes classifier, attribute weighting has received less attention than it warrants. Most approaches, perhaps influenced by attribute weighting in other machine learning algorithms, use weighting to place more emphasis on highly predictive attributes than those that are less predictive. In this paper, we argue that for naive Bayes attribute weighting should instead be used to alleviate the conditional independence assumption. Based on this premise, we propose a weighted naive Bayes algorithm, called WANBIA, that selects weights to minimize either the negative conditional log likelihood or the mean squared error objective functions. We perform extensive evaluations and find that WANBIA is a competitive alternative to state of the art classifiers like Random Forest, Logistic Regression and A1DE. © 2013 Nayyar A. Zaidi, Jesus Cerquides, Mark J. Carman and Geoffrey I. Webb.
35
Leo Breiman · Machine Learning · 2001 · 126.2K citations · Full text
UCI Machine Learning Repository
Arthur Asuncion · Medical Entomology and Zoology · 2007 · 24.4K citations
Statistical Comparisons of Classifiers over Multiple Data Sets
Janez Demšar · 2006 · 11.2K citations
Nir Friedman, Dan Geiger, Moisés Goldszmidt · Machine Learning · 1997 · 4.7K citations · Full text