IEEE Access · 2023 · 30 citations · 31 references
EngineeringDecision SciencesEnergy ManagementMachine LearningRenewable Energy SystemsEnergy Management SystemsEnergy StorageEnergy System ModelingPolicy LearningReinforcement LearningRenewable EnergyBattery Energy Management SystemsBattery Energy StorageEnergy Cost OptimizationEnergy Management ControlHyperparameter TuningPolicy OptimizationProximal Policy OptimizationTechno-economic Analysis
This article addresses the development and tuning of an energy management for a photovoltaic (PV) battery storage system for the cost-optimized use of PV energy using of reinforcement learning (RL). An energy management concept based on the Proximal Policy Optimization algorithm in combination with recurrent Long Short-Term Memory neural networks is developed for data-based policy learning. As a reference system for the simulation-based investigations, a PV battery storage system is modelled, parametrized and implemented with an interface for the RL algorithm. To demonstrate the generalization capability of the learned energy management, 98 training and 12 evaluation episodes, each with a length of one year, are generated from an empirical dataset of global radiation and load power time series. To improve the convergence speed and stability of the RL algorithm as well as the learned policy with regards to techno-economic metrics, an extensive hyperparameter study is conducted by training 216 control policies with different hyperparameter configurations. Simulation-based benchmark tests of the learned energy management against conventional rule-based and model-predictive energy managements show that the RL-based concept can achieve slightly better results in terms of energy costs and the amount of energy fed into the grid than the commonly used model-predictive method.
31
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
Reinforcement Learning: An Introduction
Richard S. Sutton, Andy Barto · IEEE Transactions on Neural Networks · 1998 · 27.1K citations
Continuous control with deep reinforcement learning
Timothy Lillicrap, Jonathan J. Hunt, Alexander Pritzel et al. · arXiv (Cornell University) · 2016 · 6.8K citations · Full text
Computing, Computer Science, Physics +17