2010 · 36 citations · 7 references
ComputingComputer ScienceComputer SystemsDistributed SystemsMachine LearningTime Series AnalysisAnomaly DetectionAnomaly Detection In Time SeriesDistributed ComputingDistributed Data ProcessingFault DetectionReal-time AnalyticsHeuristic ApproachHysteresisMapreduceMapreduce AlgorithmsOnline Anomaly DetectionReal-time Data ProcessingReal-time MonitoringStorage Stack Architecture
The high rate of data samples reported by devices that support PMU functionality forces the use of non-traditional methods in order to attempt realtime anomaly detection. Two methods discussed are offline machine learning and a realtime sliding window procedure. In using machine learning techniques it is possible to assert a classifier algorithm, which to a certain degree of accuracy can flag incoming data for further operation when applied in realtime. The open source project Hadoop provides the storage architecture for large datasets (petabyte scale) as well as the MapReduce computational framework for distributed computing to produce these classifiers. Additionally, a sliding window of realtime data can be used to present a longer data sample window than the device report rate allowing for a heuristic hysteresis approach. The open source openPDC promotes the implementation of the classifier and sliding window in a realtime environment operating on new measurements thirty times a second.
7
Sanjay Ghemawat · Communications of the ACM · 2008 · 18.5K citations · Full text
Fay W. Chang, Sanjay Ghemawat, Wilson C. Hsieh et al. · ACM Transactions on Computer Systems · 2008 · 3.4K citations
Sanjay Ghemawat, Howard Gobioff, Shun-Tak A. Leung · 2003 · 1.3K citations
Fast time series classification using numerosity reduction
Xiaopeng Xi, Eamonn Keogh, Christian R. Shelton et al. · 2006 · 597 citations