Smart City Gnosys

Smart city article details

Title	Intelligent Traffic Light Via Policy-Based Deep Reinforcement Learning
ID_Doc	32611
Authors	Zhu Y.; Cai M.; Schwarz C.W.; Li J.; Xiao S.
Year	2022
Published	International Journal of Intelligent Transportation Systems Research, 20, 3
DOI	http://dx.doi.org/10.1007/s13177-022-00321-5
Abstract	Intelligent traffic lights in smart cities can optimally reduce traffic congestion. In this study, we employ reinforcement learning to train the control agent of a traffic light on a simulator of urban mobility. As a difference from existing works, a policy-based deep reinforcement learning method, Proximal Policy Optimization (PPO), is utilized rather than value-based methods such as Deep Q Network (DQN) and Double DQN (DDQN). First, the obtained optimal policy from PPO is compared to those from DQN and DDQN. It is found that the policy from PPO performs better than the others. Next, instead of fixed-interval traffic light phases, we adopt light phases with variable time intervals, which result in a better policy to pass the traffic flow. Then, the effects of environment and action disturbances are studied to demonstrate that the learning-based controller is robust. Finally, we consider unbalanced traffic flows and find that an intelligent traffic light can perform moderately well for the unbalanced traffic scenarios, although it learns the optimal policy from the balanced traffic scenarios only. © 2022, The Author(s), under exclusive licence to Intelligent Transportation Systems Japan.
Author Keywords	Policy; Reinforcement learning; Traffic light control

Similar Articles

Id	Similarity	Authors	Title	Published
29723	0.937	Faqir N.; Ennaji Y.; Chakir L.; Boumhidi J.	Hybrid Cnn-Lstm And Proximal Policy Optimization Model For Traffic Light Control In A Multi-Agent Environment	IEEE Access, 13 (2025)
18026	0.927	Faqir N.; En-Nahnahi N.; Boumhidi J.	Deep Q-Learning Approach For Congestion Problem In Smart Cities	4th International Conference on Intelligent Computing in Data Sciences, ICDS 2020 (2020)
58613	0.926	Paduraru C.; Paduraru M.; Stefanescu A.	Traffic Light Control Using Reinforcement Learning: A Survey And An Open Source Implementation	International Conference on Vehicle Technology and Intelligent Transport Systems, VEHITS - Proceedings (2022)
6356	0.923	Kumar R.; Sharma N.V.K.; Chaurasiya V.K.	Adaptive Traffic Light Control Using Deep Reinforcement Learning Technique	Multimedia Tools and Applications, 83, 5 (2024)
44891	0.912	Hu X.; He Y.	Reinforcement Learning-Based Adaptive Optimal Control Model For Signal Light In Intelligent Transportation Systems	Journal of Circuits, Systems and Computers, 34, 2 (2025)
57625	0.911	Ait Ouallane A.; Bahnasse A.; Bakali A.; Talea M.	Toward A Smart City: Reinforcement Learning For Traffic Light Control	Lecture Notes in Networks and Systems, 629 LNNS (2023)
44882	0.907	Bohra A.R.; Selvi T.; Vishal V.; Sunkara P.S.; Sunku B.; Jignesh B.N.	Reinforcement Learning For Adaptive Traffic Signal Control Using Deep Q-Networks	1st International Conference on Sustainable Energy Technologies and Computational Intelligence: Towards Sustainable Energy Transition, SETCOM 2025 (2025)
38098	0.906	Fereidooni Z.; Palesi L.A.I.; Nesi P.	Multi-Agent Optimizing Traffic Light Signals Using Deep Reinforcement Learning	IEEE Access, 13 (2025)
38227	0.899	Lam H.C.; Wong R.T.K.; Jasser M.B.; Chua H.N.; Issa B.	Multi-Junction Traffic Light Control System With Reinforcement Learning In Sunway Smart City	2024 IEEE International Conference on Automatic Control and Intelligent Systems, I2CACIS 2024 - Proceedings (2024)
44895	0.896	Barta Z.; Kovács S.; Botzheim J.	Reinforcement Learning-Based Cooperative Traffic Control System	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 14811 LNAI (2024)