IEEE Transactions on Cybernetics · 2018 · 46 citations · 47 references
ComputingComputer ScienceData MiningMachine LearningProbability TheoryDensity EstimationKernel Density EstimationKernel MethodsProbabilistic Machine LearningStreaming AlgorithmsTime Series ClassificationAsymptotic PropertiesConcept DriftConvergenceData StreamingDensityKernel-based EstimationStreaming Data MiningStreaming Machine Learning
In this paper, we propose a recursive variant of the Parzen kernel density estimator (KDE) to track changes of dynamic density over data streams in a nonstationary environment. In stationary environments, well-established traditional KDE techniques have nice asymptotic properties. Their existing extensions to deal with stream data are mostly based on various heuristic concepts (losing convergence properties). In this paper, we study recursive KDEs, called recursive concept drift tracking KDEs, and prove their weak (in probability) and strong (with probability one) convergence, resulting in perfect tracking properties as the sample size approaches infinity. In three theorems and subsequent examples, we show how to choose the bandwidth and learning rate of a recursive KDE in order to ensure weak and strong convergence. The simulation results illustrate the effectiveness of our algorithm both for density estimation and classification over time-varying stream data.
47
A Stochastic Approximation Method
Herbert Robbins, Sutton Monro · The Annals of Mathematical Statistics · 1951 · 9.6K citations · Full text
Donald F. Specht · Neural Networks · 1990 · 3.8K citations
Applied nonparametric regression
Choice Reviews Online · 1991 · 2.6K citations