2011 · 73 citations · 17 references
ComputingComputer ScienceData ScienceData MiningMachine LearningPredictive AnalyticsAnomaly DetectionClassificationDiagnostic Decision SupportPattern EvaluationRepresentation LearningClassification AccuracyClassification Accuracy MetricsDescription Length PrinciplesExplainable Anomaly DetectionFrequent Itemset MiningMinimum Description LengthNewborn ScreeningRare Itemset Mining
In many situations there exists an abundance of positive examples, but only a handful of negatives. In this paper we show how in binary or transaction data such rare cases can be identified and characterised. Our approach uses the Minimum Description Length principle to decide whether an instance is drawn from the training distribution or not. By using frequent itemsets to construct this compressor, we can easily and thoroughly characterise the decisions, and explain what changes in an example would lead to a different verdict. Furthermore, we give a technique through which, given only a few negative examples, the decision landscape and optimal boundary can be predicted—making the approach parameter-free. Experimentation on benchmark and real data shows our method provides very high classification accuracy, thorough and insightful characterisation of decisions, predicts the decision landscape reliably, and can pinpoint observation errors. Moreover, a case study on real MCADD data shows we provide an interpretable approach with state-of-the-art performance for screening newborn babies for rare diseases.
17
Estimating the Support of a High-Dimensional Distribution
Bernhard Schölkopf, John Platt, John Shawe‐Taylor et al. · Neural Computation · 2001 · 5.9K citations
Support Vector Data Description
David M. J. Tax, Robert P. W. Duin · Machine Learning · 2003 · 3.5K citations · Full text
Novelty detection: a review—part 1: statistical approaches
M. Markou, Sameer Singh · Signal Processing · 2003 · 1.4K citations
One-Class Novelty Detection for Seizure Analysis from Intracranial EEG
Andrew B. Gardner, Abba Μ. Krieger, George Vachtsevanos et al. · 2006 · 277 citations
Spam Filtering Using Statistical Data Compression Models
Andrej Bratko, Bogdan Filipič, Gordon V. Cormack et al. · 2006 · 249 citations