Conference on Email and Anti-Spam · 2004 · 82 citations · 14 references
ComputingComputer ScienceFeature EngineeringMachine LearningNatural Language ProcessingEmail CommunicationInformation ExtractionPattern RecognitionRepresentation LearningText Feature EngineeringText MiningEmail Thread StructureFeature Engineering For Text DataFeature LearningSequence ClassificationSpam DetectionSpeech-to-text SystemsText Feature Construction
We describe methods for automatically identifying signature blocks and reply lines in plain-text email messages. This analysis has many potential applications, such as preprocessing email for text-to-speech systems; anonymization of email corpora; improving automatic content-based mail classifiers; and email threading. Our method is based on applying machine learning methods to a sequential representation of an email message, in which each email is represented as a sequence of lines, and each line is represented as a set of features. We compare several state-of-the-art sequential and non-sequential machine learning algorithms on different feature sets, and present experimental results showing that the presence of a signature block in a message can be detected with accuracy higher than 97%; that signature block lines can be identified with accuracy higher than 99%; and that signature block and reply lines can be simultaneously identified with accuracy of higher than 98%.
14
Improved boosting algorithms using confidence-rated predictions
Robert E. Schapire, Yoram Singer · 1998 · 2.6K citations
Discriminative training methods for hidden Markov models
Michael Collins · 2002 · 1.9K citations · Full text
Shallow parsing with conditional random fields
Fei Sha, Fernando Pereira · 2003 · 1.3K citations · Full text