Smart City Gnosys

Smart city article details

Title	Smart City: Application Of Multi-Agent Reinforcement Learning Systems In Adaptive Traffic Management
ID_Doc	50634
Authors	Ahmadi K.; Allan V.H.
Year	2021
Published	2021 IEEE International Smart Cities Conference, ISC2 2021
DOI	http://dx.doi.org/10.1109/ISC253183.2021.9562951
Abstract	Traffic congestion on urban road networks has increased substantially during the last decade, characterized by slower speeds, longer travel times, increased vehicular queuing, and increased pollution. The main pain point in traffic management is the static nature of our city structures that cannot adapt to the traffic dynamics changing throughout the day. This work focuses on a futuristic smart city design where making structural changes to the city graph is possible. These changes include modifying number of lanes, opening or closing the ramps, and changing signal timings on road segments. We also assume the local observability of the system where sensors can provide all the data needed for decision making. Under these assumptions, we propose a multi agent reinforcement learning framework for improving traffic flow in city networks. Our learning agents observe their assigned environment and find the best structural changes based on a set of features that represent the recent traffic condition, dependent road segment characteristics, recent structural modifications, etc. Our results show that the proposed framework improves the total travel time (TTT) by 31.5% during rush hours in Salt Lake City area. © 2021 IEEE.
Author Keywords	Explore/Exploit; Markov Decision Process; Multi-agent system; Reinforcement learning

Similar Articles

Id	Similarity	Authors	Title	Published
11516	0.912	Giannini F.; Franze G.; Pupo F.; Fortino G.	Autonomous Vehicles In Smart Cities: A Deep Reinforcement Learning Solution	Proceedings of the 2022 IEEE International Conference on Dependable, Autonomic and Secure Computing, International Conference on Pervasive Intelligence and Computing, International Conference on Cloud and Big Data Computing, International Conference on Cyber Science and Technology Congress, DASC/PiCom/CBDCom/CyberSciTech 2022 (2022)
57625	0.909	Ait Ouallane A.; Bahnasse A.; Bakali A.; Talea M.	Toward A Smart City: Reinforcement Learning For Traffic Light Control	Lecture Notes in Networks and Systems, 629 LNNS (2023)
38103	0.906	Sabit H.	Multi-Agent Reinforcement Learning For Smart City Automated Traffic Light Control	Proceedings - 2023 IEEE International Conference on High Performance Computing and Communications, Data Science and Systems, Smart City and Dependability in Sensor, Cloud and Big Data Systems and Application, HPCC/DSS/SmartCity/DependSys 2023 (2023)
54026	0.906	Louati A.; Louati H.; Kariri E.; Neifar W.; Hassan M.K.; Khairi M.H.H.; Farahat M.A.; El-Hoseny H.M.	Sustainable Smart Cities Through Multi-Agent Reinforcement Learning-Based Cooperative Autonomous Vehicles	Sustainability (Switzerland) , 16, 5 (2024)
44895	0.906	Barta Z.; Kovács S.; Botzheim J.	Reinforcement Learning-Based Cooperative Traffic Control System	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 14811 LNAI (2024)
21429	0.905	Skoropad V.N.; Deđanski S.; Pantović V.; Injac Z.; Vujičić S.; Jovanović-Milenković M.; Jevtić B.; Lukić-Vujadinović V.; Vidojević D.; Bodolo I.	Dynamic Traffic Flow Optimization Using Reinforcement Learning And Predictive Analytics: A Sustainable Approach To Improving Urban Mobility In The City Of Belgrade	Sustainability (Switzerland), 17, 8 (2025)
32025	0.904	Fatorachian H.; Kazemi H.	Integrating Learning-Based Solutions In Intelligent Transportation Systems: A Conceptual Framework And Case Studies Validation	Cogent Engineering, 11, 1 (2024)
23735	0.901	Sattarzadeh A.R.; Pathirana P.N.	Enhancing Adaptive Traffic Control Systems With Deep Reinforcement Learning And Graphical Models	Proceedings - 2024 IEEE International Conference on Future Machine Learning and Data Science, FMLDS 2024 (2024)
25829	0.901	Thamaraiselvi K.; Bohra A.R.; Vishal V.; Sunkara P.S.; Sunku B.; Nityajignesh B.	Exploring Traffic Signal Control: A Comprehensive Survey On Reinforcement Learning Techniques	3rd IEEE International Conference on Industrial Electronics: Developments and Applications, ICIDeA 2025 (2025)
58613	0.899	Paduraru C.; Paduraru M.; Stefanescu A.	Traffic Light Control Using Reinforcement Learning: A Survey And An Open Source Implementation	International Conference on Vehicle Technology and Intelligent Transport Systems, VEHITS - Proceedings (2022)