2008 · 104 citations · 29 references
EngineeringUrban PlanningAutonomous VehiclesMachine LearningMarkov Decision ProcessesIntelligent Transportation SystemsOptimal ControlReinforcement LearningTraffic EngineeringTraffic Flow TheoryTraffic OperationsAdaptive Traffic ControlAdaptive Traffic Control SystemsGlobal Positioning SystemTraffic ControlTraffic ManagementTraffic Pattern AnalysisUrban Traffic FlowVehicle-to-infrastructure Communication
The high growth rate of vehicles per capita now poses a real challenge to efficient urban traffic control (UTC). An efficient solution to UTC must be adaptive in order to deal with the highly-dynamic nature of urban traffic. In the near future, global positioning systems and vehicle-to-vehicle/infrastructure communication may provide a more detailed local view of the traffic situation that could be employed for better global UTC optimization. In this paper we describe the design of a next-generation UTC system that exploits such local knowledge about a junction's traffic in order to optimize traffic control. Global UTC optimization is achieved using a local adaptive round robin (ARR) phase switching model optimized using collaborative reinforcement learning (CRL). The design employs an ARR-CRL-based agent controller for each signalized junction that collaborates with neighbouring agents in order to learn appropriate phase timing based on the traffic pattern. We compare our approach to non-adaptive fixed-time UTC system and to a saturation balancing algorithm in a large-scale simulation of traffic in Dublin's inner city centre. We show that the ARR-CRL approach can provide significant improvement resulting in up to ~57% lower average waiting time per vehicle compared to the saturation balancing algorithm.
29
Reinforcement Learning: An Introduction
Richard S. Sutton, Andy Barto · IEEE Transactions on Neural Networks · 1998 · 27.1K citations
Reinforcement Learning: An Introduction
IEEE Transactions on Neural Networks · 2005 · 25.8K citations
Christopher J. Watkins, Peter Dayan · Machine Learning · 1992 · 9K citations · Full text
Review of road traffic control strategies
Markos Papageorgiou, C. Kiakaki, Vaya Dinopoulou et al. · Proceedings of the IEEE · 2003 · 1.2K citations · Full text
Engineering, Automotive Engineering, Transportation Planning +12