ACM Transactions on Autonomous and Adaptive Systems · 2017 · 70 citations · 36 references
ComputingAutonomous SystemsArtificial IntelligenceMachine LearningMarkov Decision ProcessesIntelligent AgentsMulti-agent SystemsPolicy LearningReinforcement LearningSmart Grid SystemsSmart GridsAgent LearningDecentralized Policy LearningLearning In Multi-agent SystemsMachine Learning For Smart GridsMulti-agent LearningMulti-agent Policy LearningMulti-agent Reinforcement LearningReinforcement Learning Theory
Multi-agent reinforcement learning (MARL) is a widely researched technique for decentralised control in complex large-scale autonomous systems. Such systems often operate in environments that are continuously evolving and where agents’ actions are non-deterministic, so called inherently non-stationary environments. When there are inconsistent results for agents acting on such an environment, learning and adapting is challenging. In this article, we propose P-MARL, an approach that integrates prediction and pattern change detection abilities into MARL and thus minimises the effect of non-stationarity in the environment. The environment is modelled as a time-series, with future estimates provided using prediction techniques. Learning is based on the predicted environment behaviour, with agents employing this knowledge to improve their performance in realtime. We illustrate P-MARL’s performance in a real-world smart grid scenario, where the environment is heavily influenced by non-stationary power demand patterns from residential consumers. We evaluate P-MARL in three different situations, where agents’ action decisions are independent, simultaneous, and sequential. Results show that all methods outperform traditional MARL, with sequential P-MARL achieving best results.
36
Corinna Cortes, Vladimir Vapnik · Machine Learning · 1995 · 33K citations · Full text
Time Series Analysis: Forecasting and Control
Michael D. Geurts, George E. P. Box, Gwilym M. Jenkins · Journal of Marketing Research · 1977 · 19.3K citations
Computing, Data Science, Forecasting +11
Christopher J. Watkins, Peter Dayan · Machine Learning · 1992 · 9K citations · Full text
Teuvo Kohonen · Proceedings of the IEEE · 1990 · 8.2K citations