arXiv (Cornell University) · 2019 · 30 citations · 32 references
ComputingMathematicsDynamical SystemsMachine LearningStatistical LearningActive LearningBias-variance TradeoffParameter Estimation Under UncertaintyState EstimationStatistical InferenceSystem IdentificationDynamical Systems ModelingLeast Squares EstimationLeast Squares ProblemsNewtonian MechanicsPartially Observed ModelsRobust InferenceSemi-parametric RegressionStochastic Dynamical Systems
We analyze a simple prefiltered variation of the least squares estimator for the problem of estimation with biased, semi-parametric noise, an error model studied more broadly in causal statistics and active learning. We prove an oracle inequality which demonstrates that this procedure provably mitigates the variance introduced by long-term dependencies. We then demonstrate that prefiltered least squares yields, to our knowledge, the first algorithm that provably estimates the parameters of partially-observed linear systems that attains rates which do not not incur a worst-case dependence on the rate at which these dependencies decay. The algorithm is provably consistent even for systems which satisfy the weaker marginal stability condition obeyed by many classical models based on Newtonian mechanics. In this context, our semi-parametric framework yields guarantees for both stochastic and worst-case noise.
32
Kemin Zhou, John C. Doyle, K. Glover · 1997 · 4.4K citations
An overview of subspace identification
S. Joe Qin · Computers & Chemical Engineering · 2006 · 590 citations