IEEE Transactions on Intelligent Transportation Systems · 2019 · 95 citations · 29 references
BusinessDecision SciencesMachine LearningMarkov Decision ProcessesOptimizationConstrained Markov Decision ProcessesMulti-objective Markov Decision ProcessesOptimal ControlReinforcement LearningTraffic EngineeringTraffic Signal ControlAgent Decision MakingDecision Making In Multi-agent SystemsIntelligent ControlMulti-agent Decision MakingMulti-objective Decision MakingReinforcement Learning For Signal ControlTraffic ControlTraffic Simulation
Agent-based approaches have gained popularity in engineering applications, but its potential for advanced traffic controls has not been sufficiently explored. This paper presents a multi-agent framework that models traffic control instruments and their interactions with road traffic. A constrained Markov decision process (CMDP) model is used to represent agent decision making in the context of multi-objective policy goals, where the policy goal with the highest priority becomes the single optimization objective and the other goals are transformed as constraints. A reinforcement learning-based computational framework is developed for control applications. To implement the multi-objective decision model, a threshold lexicographic ordering method is introduced and integrated with the learning-based algorithm. Moreover, a two-stage hybrid framework is established to improve the learning efficiency of the model. While the proposed approach is potentially applicable for different road traffic operations, this paper applies the framework for traffic signal control in a network of Stockholm based on traffic simulation. The computational results show that the proposed control approach can handle a complex case of multiple policy requirements. Meanwhile, the agent-based intelligent control has shown superior performance when compared to other optimized signal control methods.
29
Reinforcement Learning: An Introduction
Richard S. Sutton, Andy Barto · IEEE Transactions on Neural Networks · 1998 · 27.1K citations
Reinforcement Learning: An Introduction
IEEE Transactions on Neural Networks · 2005 · 25.8K citations
Reinforcement Learning: An Introduction
Jeffrey D. Johnson, Jinghong Li, Zengshi Chen · Neurocomputing · 2000 · 8.7K citations
Choice Reviews Online · 1999 · 2.6K citations