2016 · 28 citations · 14 references
ComputingComputer ScienceInformation TechnologyBig Data AnalyticsData MiningTime Series AnalysisChange DetectionError DetectionSql InjectionAbrupt Change DetectionData Stream MiningGradual Change DetectionMinimum Description LengthSequential Change AnalysisSequential Change DetectionSql Injection DetectionTime-series Change Detection
In this paper we propose a novel methodology of sequential change detection using the minimum description length (MDL)-change statistics. We first introduce the MDL-change statistics as the difference between the code-lengths with change and that without change. We give a theoretical justification for its use in the scenario of hypothesis testing. In it we evaluate the error probabilities for the MDL-change detection to relate them to the information-theoretic complexities of the probabilistic models and their discrepancy measure. We then convert the MDL-change statistics into the sequential change detection algorithm. It is designed to detect gradual changes as well as abrupt changes from big stream data. We empirically demonstrate the effectiveness of the proposed method by showing that it performs better than existing algorithms for synthetic data. We also show its validity through real problems such as SQL injection detection and failure symptom detection.
14
Modeling by shortest data description
J. Rissanen · Automatica · 1978 · 6K citations
Detection of Abrupt Changes: Theory and Application
Kurt S. Riedel · Technometrics · 1994 · 3K citations
Inference about the change-point in a sequence of random variables
D. V. Hinkley · Biometrika · 1970 · 813 citations
Bayesian Online Changepoint Detection
Ryan P. Adams, David Mackay · ArXiv.org · 2007 · 603 citations · Full text
Towards parameter-free data mining
Eamonn Keogh, Stefano Lonardi, Chotirat Ann Ratanamahatana · 2004 · 568 citations