2003 · 210 citations · 12 references
ComputingComputer ScienceMachine LearningNatural Language ProcessingText AnalyticsBayesian LearningEmail SecurityEvent DetectionFeature SelectionText Feature EngineeringText MiningAccuracyBayesian ClassifiersEmail FilteringNaive BayesNaive Bayes ClassificationSpam DetectionSpam FilteringText Classification Features
We describe experiments with a Naive Bayes text classifier in the context of anti-spam E-mail filtering, using two different statistical event models: a multi-variate Bernoulli model and a multinomial model. We introduce a family of feature ranking functions for feature selection in the multinomial event model that take account of the word frequency information. We present evaluation results on two publicly available corpora of legitimate and spam E-mails. We find that the multinomial model is less biased towards one class and achieves slightly higher accuracy than the multi-variate Bernoulli model.
12
A Comparative Study on Feature Selection in Text Categorization
Yiming Yang, Jan Pedersen · 1997 · 4.8K citations
A Bayesian Approach to Filtering Junk E-Mail
Mehran Sahami, Susan Dumais, David Heckerman et al. · 1998 · 1.2K citations