Smart Energy · 2024 · 28 citations · 23 references
ComputingComputer ScienceSystems EngineeringArtificial IntelligenceEnergy ManagementMachine LearningBuilding AutomationEnergy Management SystemsEnergy StorageEnergy System ModelingPolicy LearningReinforcement LearningDeep Reinforcement LearningElectrical Power SystemsEnergy ControlEnergy Storage SystemsEnergy-optimal ControlOptimal Energy SchedulingReal-time Decision MakingSmart Energy Systems
This research work introduces a novel approach to energy management in Smart Energy Systems (SES) using Deep Reinforcement Learning (DRL) to optimize the management of flexible energy systems in SES, including heating, cooling and electricity storage systems along with District Heating and Cooling Systems (DHCS). The proposed approach is applied on Meridia Smart Energy (MSE), a french demonstration project for SES. The proposed DRL framework, based on actor–critic architecture, is first applied on a Modelica digital twin that we developed for the MSE SES, and is benchmarked against a rule-based approach. The DRL agent learnt an effective strategy for managing thermal and electrical storage systems, resulting in optimized energy costs within the SES. Notably, the acquired strategy achieved annual cost reduction of at least 5% compared to the rule-based benchmark strategy. Moreover, the near-real time decision-making capabilities of the trained DRL agent provides a significant advantage over traditional optimization methods that require time-consuming re-computation at each decision point. By training the DRL agent on a digital twin of the real-world MSE project, rather than hypothetical simulation models, this study lays the foundation for a pioneering application of DRL in the real-world MSE SES, showcasing its potential for practical implementation. • Deep Reinforcement Learning for optimal energy management in Smart Energy Systems. • A DDPG algorithm for multiple scheduling actions on multi-energy storage systems. • Reward shaping to address sparse reward issues faced by DRL agents. • Application on a digital twin of the Meridia Smart Energy (MSE) real-world SES.
23
Human-level control through deep reinforcement learning
Volodymyr Mnih, Koray Kavukcuoglu, David Silver et al. · Nature · 2015 · 30K citations
Reinforcement Learning: An Introduction
Richard S. Sutton, Andy Barto · IEEE Transactions on Neural Networks · 1998 · 27.1K citations
Continuous control with deep reinforcement learning
Timothy Lillicrap, Jonathan J. Hunt, Alexander Pritzel et al. · arXiv (Cornell University) · 2016 · 6.8K citations · Full text
Computing, Computer Science, Physics +17
4th Generation District Heating (4GDH)
Henrik Lund, S. Werner, Robin Wiltshire et al. · Energy · 2014 · 2.1K citations
Engineering, Architectural Engineering, Mechanical Engineering +12
International Conference on Artificial Neural Networks
Habiboulaye Amadou Boubacar · Neural Networks · 1990 · 2.1K citations