Energy and AI · 2024 · 19 citations · 26 references
BusinessDecision SciencesDesign OptimizationMachine LearningOptimizationExploration-exploitation TradeoffPolicy LearningPower System DesignReinforcement LearningReinforcement Learning FoundationsEnvironment DesignLearning Environment DesignPolicy OptimizationPower Flow ControlPower Flow ManagementReinforcement Learning TheoryReward Function Design
To solve the optimal power flow (OPF) problem, reinforcement learning (RL) emerges as a promising new approach. However, the RL-OPF literature is strongly divided regarding the exact formulation of the OPF problem as an RL environment. In this work, we collect and implement diverse environment design decisions from the literature regarding training data, observation space, episode definition, and reward function choice. In an experimental analysis, we show the significant impact of these environment design options on RL-OPF training performance. Further, we derive some first recommendations regarding the choice of these design decisions. The created environment framework is fully open-source and can serve as a benchmark for future research in the RL-OPF field. • The Optimal Power Flow can be solved with Reinforcement Learning. • Literature is strongly divided regarding its formulation as a learning environment. • Systematic experiments with diverse design options from literature. • The environment design decisions impact training performance drastically. • Recommendations on how to design Optimal Power Flow environments.
26
Proceedings of the 24th international conference on Machine learning
2007 · 11.7K citations
Continuous control with deep reinforcement learning
Timothy Lillicrap, Jonathan J. Hunt, Alexander Pritzel et al. · arXiv (Cornell University) · 2016 · 6.8K citations · Full text
Computing, Computer Science, Physics +17
Biometrika · 1908 · 3.9K citations
IEEE International Conference On Robotics And Automation
2001 · 759 citations
Optimal power flow: a bibliographic survey I
Stephen Frank, Ingrida Steponavičė, Steffen Rebennack · Energy Systems · 2012 · 543 citations