Adaptive continuous-time linear quadratic Gaussian control

Abstract

The adaptive linear quadratic Gaussian control problem, where the linear transformation of the state A and the linear transformation of the control B are unknown, is solved assuming only that (A, B) is controllable and (A, Q/sub 1//sup 1/2/) is observable, where Q/sub 1/ determines the quadratic form for the state in the integrand of the cost functional. A weighted least squares algorithm is modified by using a random regularization to ensure that the family of estimated models is uniformly controllable and observable. A diminishing excitation is used with the adaptive control to ensure that the family of estimates is strongly consistent. A lagged certainty equivalence control using this family of estimates is shown to be self-optimizing for an ergodic, quadratic cost functional.