IEEE Transactions on Industrial Electronics · 2017 · 159 citations · 61 references
BusinessDecision SciencesEnergy ManagementEnergy PolicyOptimizationAdaptive ControlDynamic ProgrammingMicrogridsOptimal ControlPolicy IterationValue IterationAdaptive Energy ManagementBattery Energy Management SystemsBattery Energy StorageBattery ManagementEnergy Management AlgorithmsEnergy-optimal ControlMicrogrid OptimizationOptimal Energy Scheduling
In this paper, a novel mixed iterative adaptive dynamic programming (ADP) algorithm is developed to solve the optimal battery energy management and control problem in smart residential microgrid systems. Based on the data of the load and electricity rate, two iterations are constructed, which are P-iteration and V-iteration, respectively. The V-iteration is implemented based on value iteration, which aims to obtain the iterative control law sequence in each period. The P-iteration is implemented based on policy iteration, which updates the iterative value function according to the iterative control law sequence. Properties of the developed mixed iterative ADP algorithm are analyzed. It is shown that the iterative value function is monotonically nonincreasing and converges to the solution of the Bellman equation. In each iteration, it is proven that the performance index function is finite under the iterative control law sequence. Finally, numerical results and comparisons are given to illustrate the performance of the developed algorithm.
61
Reinforcement Learning: An Introduction
Richard S. Sutton, Andy Barto · IEEE Transactions on Neural Networks · 1998 · 27.1K citations
Danil Prokhorov, Donald C. Wunsch · IEEE Transactions on Neural Networks · 1997 · 1.2K citations