IEEE Transactions on Vehicular Technology · 2023 · 15 citations · 45 references
ComputingAutonomous SystemsAutonomous VehiclesMachine LearningMarkov Decision ProcessesAdaptive ControlMulti-agent SystemsOptimal ControlPolicy LearningReinforcement LearningTraffic OperationsDeep Reinforcement LearningIntersectionMulti-agent LearningMulti-agent Policy LearningMulti-agent Reinforcement LearningRoad Traffic NetworksTraffic Control
Despite significant advancements in Multi-Agent Deep Reinforcement Learning (MADRL) approaches for Traffic Light Control (TLC), effectively coordinating agents in diverse traffic environments remains a challenge. Studies in MADRL for TLC often focus on repeatedly constructing the same intersection models with sparse experience. However, real road networks comprise Multi-Type of Intersections (MTIs) rather than being limited to intersections with four directions. In the scenario with MTIs, each type of intersection exhibits a distinctive topology structure and phase set, leading to disparities in the spaces of state and action. This article introduces Adaptive Multi-agent Deep Mixed Reinforcement Learning (AMDMRL) for addressing tasks with multiple types of intersections in TLC. AMDMRL adopts a two-level hierarchy, where high-level proxies guide low-level agents in decision-making and updating. All proxies are updated by value decomposition to obtain the globally optimal policy. Moreover, the AMDMRL approach incorporates a mixed cooperative mechanism to enhance cooperation among agents, which adopts a mixed encoder to aggregate the information from correlated agents. We conduct comparative experiments involving four traditional and four DRL-based approaches, utilizing three training and four testing datasets. The results indicate that the AMDMRL approach achieves average reductions of 41% than traditional approaches, and 16% compared to DRL-based approaches in traveling time on three training datasets. During testing, the AMDMRL approach exhibits a 37% improvement in reward compared to the MADRL-based approaches.
45
Hua Wei, Guanjie Zheng, Huaxiu Yao et al. · 2018 · 644 citations
Samah El-Tantawy, Baher Abdulhai, Hossam Abdelgawad · IEEE Transactions on Intelligent Transportation Systems · 2013 · 523 citations