Smart City Gnosys

Smart city article details

Title	A Multi-Agent Reinforcement Learning Framework With Recurrent Communication Module For Traffic Light Control
ID_Doc	2760
Authors	Qin B.; He W.; Zhang B.; Li J.
Year	2021
Published	2021 IEEE 4th International Conference on Information Systems and Computer Aided Education, ICISCAE 2021
DOI	http://dx.doi.org/10.1109/ICISCAE52414.2021.9590701
Abstract	As a significant issue in the development of Smart City, traffic light control is closely related to public transport. Multi-agent reinforcement learning is a feasible paradigm to control decentralized systems. In this work, we design a recurrent communication module for traffic light control systems. Aiming at lightweight decentralized learning, we decouple the interaction among entities, using an improved recurrent neural network to share messages. Regarding traffic lights as a partially observable Markov Decision Process, we develop a complete reinforcement learning model. Every light receives messages from its neighbors through the improved recurrent neural network. For the further lights, its neighbor lights can play the role of intermediation to transmit messages. By our communication framework, traffic lights can learn their control policies in a decentralized way, and distribution control can be executed through a communication channel. Several simulated experiments show that our method outperforms the fixed time method and the existing reinforcement learning-based frameworks under different traffic demands. © 2021 IEEE.
Author Keywords	multi-agent reinforcement learning; traffic demands; traffic light control

Similar Articles

Id	Similarity	Authors	Title	Published
38103	0.912	Sabit H.	Multi-Agent Reinforcement Learning For Smart City Automated Traffic Light Control	Proceedings - 2023 IEEE International Conference on High Performance Computing and Communications, Data Science and Systems, Smart City and Dependability in Sensor, Cloud and Big Data Systems and Application, HPCC/DSS/SmartCity/DependSys 2023 (2023)
34880	0.908	Zhang Y.; Yu Z.; Zhang J.; Wang L.; Luan T.H.; Guo B.; Yuen C.	Learning Decentralized Traffic Signal Controllers With Multi-Agent Graph Reinforcement Learning	IEEE Transactions on Mobile Computing, 23, 6 (2024)
58613	0.906	Paduraru C.; Paduraru M.; Stefanescu A.	Traffic Light Control Using Reinforcement Learning: A Survey And An Open Source Implementation	International Conference on Vehicle Technology and Intelligent Transport Systems, VEHITS - Proceedings (2022)
57625	0.895	Ait Ouallane A.; Bahnasse A.; Bakali A.; Talea M.	Toward A Smart City: Reinforcement Learning For Traffic Light Control	Lecture Notes in Networks and Systems, 629 LNNS (2023)
38227	0.893	Lam H.C.; Wong R.T.K.; Jasser M.B.; Chua H.N.; Issa B.	Multi-Junction Traffic Light Control System With Reinforcement Learning In Sunway Smart City	2024 IEEE International Conference on Automatic Control and Intelligent Systems, I2CACIS 2024 - Proceedings (2024)
32611	0.89	Zhu Y.; Cai M.; Schwarz C.W.; Li J.; Xiao S.	Intelligent Traffic Light Via Policy-Based Deep Reinforcement Learning	International Journal of Intelligent Transportation Systems Research, 20, 3 (2022)
24038	0.889	Vieira M.A.; Galvão G.; Vieira M.; Véstias M.; Louro P.; Jardim-Goncalves R.	Enhancing Traffic Flow With Visible Light Communication: A Deep Reinforcement Learning Approach	Proceedings of SPIE - The International Society for Optical Engineering, 13374 (2025)
44895	0.889	Barta Z.; Kovács S.; Botzheim J.	Reinforcement Learning-Based Cooperative Traffic Control System	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 14811 LNAI (2024)
29723	0.886	Faqir N.; Ennaji Y.; Chakir L.; Boumhidi J.	Hybrid Cnn-Lstm And Proximal Policy Optimization Model For Traffic Light Control In A Multi-Agent Environment	IEEE Access, 13 (2025)
15928	0.884	Zhu R.; Wu S.; Li L.; Lv P.; Xu M.	Context-Aware Multiagent Broad Reinforcement Learning For Mixed Pedestrian-Vehicle Adaptive Traffic Light Control	IEEE Internet of Things Journal, 9, 20 (2022)