Multiscale Modeling and Simulation · 2019 · 161 citations · 18 references
ComputingComputer ScienceMathematicsAlgorithmsDynamical SystemsTime Series AnalysisApproximation AlgorithmsConvergence AnalysisNonlinear DynamicsSystem IdentificationConvergenceLeast Squares ProblemsNonlinear System IdentificationSparse Identification Of Nonlinear DynamicsSparse Parameter EstimationSparsity ConstraintsSparsity Problem
One way to understand time-series data is to identify the underlying dynamical system which generates it. This task can be done by selecting an appropriate model and a set of parameters which best fits the dynamics while providing the simplest representation (i.e., the smallest amount of terms). One such approach is the sparse identification of nonlinear dynamics framework [6], which uses a sparsity-promoting algorithm that iterates between a partial least-squares fit and a thresholding (sparsity-promoting) step. In this work, we provide some theoretical results on the behavior and convergence of the algorithm proposed in [S. L. Brunton, J. L. Proctor, and J. N. Kutz, Proc. Nat. Acad. Sci. USA, 113 (2016), pp. 3932--3937]. In particular, we prove that the algorithm approximates local minimizers of an unconstrained $\ell^0$-penalized least-squares problem. From this, we provide sufficient conditions for general convergence, rate of convergence, conditions for one-step recovery, and a recovery result with respect to the condition number and noise. Examples illustrate that the rates of convergence are sharp. In addition, our results extend to other algorithms related to the algorithm in [S. L. Brunton, J. L. Proctor, and J. N. Kutz, Proc. Nat. Acad. Sci. USA, 113 (2016), pp. 3932--3937], and provide theoretical verification of several observed phenomena.
18
Distilling Free-Form Natural Laws from Experimental Data
Michael Schmidt, Hod Lipson · Science · 2009 · 2.8K citations
Data-driven discovery of partial differential equations
Samuel Rudy, Steven L. Brunton, Joshua L. Proctor et al. · Science Advances · 2017 · 1.5K citations · Full text