EngineeringChemical EngineeringChemistryMachine LearningMarkov Decision ProcessesProcess ControlChemical ControlController DesignPolicy LearningReinforcement LearningReinforcement Learning FoundationsStochastic ControlChemical Process SystemsConstrained Reinforcement LearningControl Barrier FunctionsProbabilistic Safety AnalysisReinforcement Learning TheorySafe Policy LearningSafe Reinforcement LearningSafety Constraints
This paper reviews the recent advancements of reinforcement learning (RL) for chemical process control. RL presents a systematic strategy in which the machine learning agent learns a policy of actions based on interactions with the environment. We first provide a brief overview of RL theoretic basis built on Markov decision processes (MDPs) and then move onto its application to process control. With particular interest in chemical processes, we review state-of-the-art research developments on RL for controller tuning and direct control policy learning. This work highlights the importance of safe RL control to incorporate deterministic or probabilistic safety constraints such as constrained MDPs, control barrier functions, etc. We conclude the review with a discussion on some of the outstanding challenges such as sampling efficiency, generalizability, uncertainty, and observability, as well as the emergent and future directions to address these limitations.
120
Human-level control through deep reinforcement learning
Volodymyr Mnih, Koray Kavukcuoglu, David Silver et al. · Nature · 2015 · 30K citations
On the Theory of the Brownian Motion
G. E. Uhlenbeck, L. S. Ornstein · Physical Review · 1930 · 4.5K citations
Domain randomization for transferring deep neural networks from simulation to the real world
Josh Tobin, Rachel Fong, Alex Ray et al. · 2017 · 2.8K citations
Richard Bellman · Indiana University Mathematics Journal · 1957 · 2.4K citations