2006 · 230 citations · 13 references
ComputingInformation TechnologyData MiningFeature EngineeringNetwork SecurityAnomaly DetectionDimensionality ReductionNetwork FlowsNetwork Traffic AnalysisOutlier DetectionAccuracyAnomaly-based DetectionFeature Dimensionality ReductionHigh-dimensional Anomaly DetectionNetwork Anomaly DetectionNetwork Traffic Anomaly DetectionSubspace Anomaly DetectionSubspace Identification
Network anomaly detection using dimensionality reduction techniques has received much recent attention in the literature. For example, previous work has aggregated netflow records into origin-destination (OD) flows, yielding a much smaller set of dimensions which can then be mined to uncover anomalies. However, this approach can only identify which OD flow is anomalous, not the particular IP flow(s) responsible for the anomaly. In this paper we show how one can use random aggregations of IP flows (i.e., sketches) to enable more precise identification of the underlying causes of anomalies. We show how to combine traffic sketches with a subspace method to (1) detect anomalies with high accuracy and (2) identify the IP flows(s) that are responsible for the anomaly. Our method has detection rates comparable to previous methods and detects many more anomalies than prior work, taking us a step closer towards a robust on-line system for anomaly detection and identification.
13
Mining anomalies using traffic feature distributions
Anukool Lakhina, Mark Crovella, Christophe Diot · 2005 · 1.1K citations · Full text
Diagnosing network-wide traffic anomalies
Anukool Lakhina, Mark Crovella, Christophe Diot · 2004 · 1K citations · Full text
A signal analysis of network traffic anomalies
Paul Barford, Jeffery Kline, David Plonka et al. · 2002 · 785 citations
New directions in traffic measurement and accounting
Cristian Estan, George Varghese · 2001 · 742 citations
Anomaly detection in IP networks
Marina Thottan, Chuanyi Ji · IEEE Transactions on Signal Processing · 2003 · 546 citations