Smart City Gnosys

Smart city article details

Title	Information Upwards, Recommendation Downwards: Reinforcement Learning With Hierarchy For Traffic Signal Control
ID_Doc	31510
Authors	Antes T.D.O.; Bazzan A.L.C.; Tavares A.R.
Year	2022
Published	Procedia Computer Science, 201, C
DOI	http://dx.doi.org/10.1016/j.procs.2022.03.006
Abstract	Traffic signal control (TSC) is a practical solution to the major problem of congestion in metropolitan areas. Reinforcement Learning (RL) techniques present powerful frameworks for optimizing traffic signal controllers that learn to respond to real-time traffic changes. Multiagent RL (MARL) techniques have been showing better results over centralized techniques (RL-based or not), where local intersection agents have partial observation of and control over the environment. Since in TSC the best decision does not depend only on local information, in the present paper we aim at increasing agents' views by using a hierarchical approach, where information is passed upwards, is then aggregated forming recommendations that are sent downwards. We divide the transportation network into regions, each controlled by a region agent; this is done at different hierarchical levels. The traffic signal controllers, located at the intersections, are the local agents at the hierarchy's bottom. Region agents can supervise intersection agents or other region agents. Evaluation of this approach in a synthetic traffic grid shows that the proposed hierarchical organization outperforms a fixed-time approach and an RL-based approach without hierarchy. © 2022 Elsevier B.V.. All rights reserved.
Author Keywords	Intelligent Transportation Systems; Multiagent Systems; Reinforcement Learning; Smart Cities

Similar Articles

Id	Similarity	Authors	Title	Published
25829	0.889	Thamaraiselvi K.; Bohra A.R.; Vishal V.; Sunkara P.S.; Sunku B.; Nityajignesh B.	Exploring Traffic Signal Control: A Comprehensive Survey On Reinforcement Learning Techniques	3rd IEEE International Conference on Industrial Electronics: Developments and Applications, ICIDeA 2025 (2025)
55970	0.889	Yilin L.; Jinglin L.	The Intersection Of Companions: Differential Traffic Signal Control In Multi-Agent Systems	Proceedings of 2022 8th IEEE International Conference on Cloud Computing and Intelligence Systems, CCIS 2022 (2022)
21559	0.886	Chen J.-Y.; Wei F.-F.; Chen T.-Y.; Hu X.-M.; Jeon S.-W.; Wang Y.; Chen W.-N.	Earl-Light: An Evolutionary Algorithm-Assisted Reinforcement Learning For Traffic Signal Control	Conference Proceedings - IEEE International Conference on Systems, Man and Cybernetics (2024)
38103	0.88	Sabit H.	Multi-Agent Reinforcement Learning For Smart City Automated Traffic Light Control	Proceedings - 2023 IEEE International Conference on High Performance Computing and Communications, Data Science and Systems, Smart City and Dependability in Sensor, Cloud and Big Data Systems and Application, HPCC/DSS/SmartCity/DependSys 2023 (2023)
23735	0.879	Sattarzadeh A.R.; Pathirana P.N.	Enhancing Adaptive Traffic Control Systems With Deep Reinforcement Learning And Graphical Models	Proceedings - 2024 IEEE International Conference on Future Machine Learning and Data Science, FMLDS 2024 (2024)
6267	0.873	Wang M.; Wang H.; Wei S.; Zhang D.	Adaptive Joint Control Of Intersection Traffic Signals And Variable Lanes Using Multi-Agent Learning	IET Intelligent Transport Systems, 19, 1 (2025)
40923	0.873	Zhang Z.; Zhou B.; Zhang B.; Cheng P.; Lee D.-H.; Hu S.	Optimizing Traffic Signal Control In Mixed Traffic Scenarios: A Predictive Traffic Information-Based Deep Reinforcement Learning Approach	2024 Forum for Innovative Sustainable Transportation Systems, FISTS 2024 (2024)
58670	0.871	Agafonov A.; Myasnikov V.	Traffic Signal Control: A Double Q-Learning Approach	Proceedings of the 16th Conference on Computer Science and Intelligence Systems, FedCSIS 2021 (2021)
44895	0.868	Barta Z.; Kovács S.; Botzheim J.	Reinforcement Learning-Based Cooperative Traffic Control System	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 14811 LNAI (2024)
34880	0.868	Zhang Y.; Yu Z.; Zhang J.; Wang L.; Luan T.H.; Guo B.; Yuen C.	Learning Decentralized Traffic Signal Controllers With Multi-Agent Graph Reinforcement Learning	IEEE Transactions on Mobile Computing, 23, 6 (2024)