Smart City Gnosys
Smart city article details
| Title | Hybrid Cnn-Lstm And Proximal Policy Optimization Model For Traffic Light Control In A Multi-Agent Environment |
|---|---|
| ID_Doc | 29723 |
| Authors | Faqir N.; Ennaji Y.; Chakir L.; Boumhidi J. |
| Year | 2025 |
| Published | IEEE Access, 13 |
| DOI | http://dx.doi.org/10.1109/ACCESS.2025.3541042 |
| Abstract | Conventional traffic light control systems often exhibit rigid timing patterns, limited flexibility, and insufficient adaptability to changing traffic conditions. This paper addresses urban traffic management challenges, addressing researchers and professionals in traffic engineering and intelligent transportation systems. To overcome these challenges, this paper presents an innovative traffic light control method, integrating a CNN-LSTM model for traffic state prediction, combined with a Proximal Policy Optimization (PPO) algorithm for traffic light control decision-making. The model is based on a representation of intersection states through key indicators (such as active green phase, congestion levels, congestion variations, and vehicle speeds) and employs deep reinforcement learning to optimize traffic light control strategies. The adopted method is compared with fixed traffic light control approaches and a reinforcement learning (Q-learning) approach in a simulated environment using SUMO. The simulations consider diverse traffic scenarios and realistic urban conditions to ensure robust evaluation. The experimental results indicate that traffic efficiency is significantly improved by up to 92% in scenarios managing medium traffic demand, with up to 2000 vehicles per hour in the North-South scenario, while congestion indicators are substantially reduced. These improvements are achieved under conditions where traffic remains below the saturation threshold, ensuring stable flow management.The proposed method demonstrates its effectiveness in optimizing signalized intersections, significantly enhancing traffic flow in pre-saturation conditions, while opening perspectives for further research in oversaturated networks. These results illustrate the power of integrating spatiotemporal prediction and PPO-based control for dynamic and adaptive traffic management in urban networks. © 2013 IEEE. |
| Author Keywords | Adaptive traffic control; CNN-LSTM; multi-agent reinforcement learning; proximal policy optimization; smart cities; spatio-temporal prediction; SUMO; traffic flow optimization; traffic light control; urban traffic management |
Similar Articles
| Id | Similarity | Authors | Title | Published |
|---|---|---|---|---|
32611  | 0.937 | Zhu Y.; Cai M.; Schwarz C.W.; Li J.; Xiao S. | Intelligent Traffic Light Via Policy-Based Deep Reinforcement Learning | International Journal of Intelligent Transportation Systems Research, 20, 3 (2022) |
| 58613 | 0.93 | Paduraru C.; Paduraru M.; Stefanescu A. | Traffic Light Control Using Reinforcement Learning: A Survey And An Open Source Implementation | International Conference on Vehicle Technology and Intelligent Transport Systems, VEHITS - Proceedings (2022) |
| 57625 | 0.926 | Ait Ouallane A.; Bahnasse A.; Bakali A.; Talea M. | Toward A Smart City: Reinforcement Learning For Traffic Light Control | Lecture Notes in Networks and Systems, 629 LNNS (2023) |
| 6356 | 0.921 | Kumar R.; Sharma N.V.K.; Chaurasiya V.K. | Adaptive Traffic Light Control Using Deep Reinforcement Learning Technique | Multimedia Tools and Applications, 83, 5 (2024) |
| 26667 | 0.911 | Liu D.; Huang J. | Flight: Optimization Algorithm For Traffic Lights Based On Short-Term Traffic State Forecast | Machine Learning, 114, 7 (2025) |
| 23735 | 0.911 | Sattarzadeh A.R.; Pathirana P.N. | Enhancing Adaptive Traffic Control Systems With Deep Reinforcement Learning And Graphical Models | Proceedings - 2024 IEEE International Conference on Future Machine Learning and Data Science, FMLDS 2024 (2024) |
| 38098 | 0.906 | Fereidooni Z.; Palesi L.A.I.; Nesi P. | Multi-Agent Optimizing Traffic Light Signals Using Deep Reinforcement Learning | IEEE Access, 13 (2025) |
| 43250 | 0.904 | Sattarzadeh A.R.; Pathirana P.N. | Probabilistic Graph Models: A Key To Boosting Deep Reinforcement Learning In Urban Traffic Networks | 2025 17th International Conference on Computer and Automation Engineering, ICCAE 2025 (2025) |
| 40923 | 0.903 | Zhang Z.; Zhou B.; Zhang B.; Cheng P.; Lee D.-H.; Hu S. | Optimizing Traffic Signal Control In Mixed Traffic Scenarios: A Predictive Traffic Information-Based Deep Reinforcement Learning Approach | 2024 Forum for Innovative Sustainable Transportation Systems, FISTS 2024 (2024) |
| 18026 | 0.903 | Faqir N.; En-Nahnahi N.; Boumhidi J. | Deep Q-Learning Approach For Congestion Problem In Smart Cities | 4th International Conference on Intelligent Computing in Data Sciences, ICDS 2020 (2020) |