Smart City Gnosys

Smart city article details

Title	Cooperative Traffic Scheduling In Transportation Network: A Knowledge Transfer Method
ID_Doc	16165
Authors	Huang Z.; Dai W.; Zou Y.; Li D.; Cai J.; Gadekallu T.R.; Wang W.
Year	2025
Published	IEEE Transactions on Intelligent Transportation Systems
DOI	http://dx.doi.org/10.1109/TITS.2025.3542274
Abstract	Deep reinforcement learning (DRL) has shown significant potential in adaptive traffic signal control (ATSC) by adapting to real-time traffic conditions. However, controlling multiple intersections faces challenges, mainly due to the isolated actions of agents and non-stationary caused by other intersections. To address these issues, this paper proposes a novel knowledge collaboration-based actor-critic policy gradient (KCACPG) method to achieve cooperative traffic scheduling across multiple intersections. KCACPG includes a knowledge collaboration learning mechanism that allows heterogeneous agents to exchange knowledge across experience tuples, achieving globally optimal decision-making and coordination. KCACPG also integrates an off-policy prioritized experience replay mechanism to improve knowledge reuse efficiency and reduce the negative impact of knowledge transfer. Simulation results show that KCACPG converges quickly, generalizes to fluctuant traffic and load well, improves the network throughput by up to 17.8%, and reduces the pressure imbalance by up to 11.6% compared with the existing collaborative methods. The proposed method has significant implications for intelligent transportation systems and smart cities. © 2000-2011 IEEE All rights reserved.
Author Keywords	adaptive traffic signal control; Deep reinforcement learning; knowledge collaboration; transportation network

Similar Articles

Id	Similarity	Authors	Title	Published
44895	0.898	Barta Z.; Kovács S.; Botzheim J.	Reinforcement Learning-Based Cooperative Traffic Control System	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 14811 LNAI (2024)
23735	0.896	Sattarzadeh A.R.; Pathirana P.N.	Enhancing Adaptive Traffic Control Systems With Deep Reinforcement Learning And Graphical Models	Proceedings - 2024 IEEE International Conference on Future Machine Learning and Data Science, FMLDS 2024 (2024)
40923	0.887	Zhang Z.; Zhou B.; Zhang B.; Cheng P.; Lee D.-H.; Hu S.	Optimizing Traffic Signal Control In Mixed Traffic Scenarios: A Predictive Traffic Information-Based Deep Reinforcement Learning Approach	2024 Forum for Innovative Sustainable Transportation Systems, FISTS 2024 (2024)
33264	0.879	Reda M.; Mountassir F.; Mohamed B.	Introduction To Coordinated Deep Agents For Traffic Signal	2019 International Conference on Wireless Technologies, Embedded and Intelligent Systems, WITS 2019 (2019)
15627	0.879	Sachan A.; Chauhan N.S.; Kumar N.	Congestion Minimization Using Fog-Deployed Drl-Agent Feedback Enabled Traffic Light Cooperative Framework	Proceedings - 23rd IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing, CCGrid 2023 (2023)
50634	0.878	Ahmadi K.; Allan V.H.	Smart City: Application Of Multi-Agent Reinforcement Learning Systems In Adaptive Traffic Management	2021 IEEE International Smart Cities Conference, ISC2 2021 (2021)
6267	0.878	Wang M.; Wang H.; Wei S.; Zhang D.	Adaptive Joint Control Of Intersection Traffic Signals And Variable Lanes Using Multi-Agent Learning	IET Intelligent Transport Systems, 19, 1 (2025)
18057	0.876	Mittal M.; Sehgal A.; Varshney N.; Kumar S.P.; Boob N.S.; Reddy R.A.	Deep Reinforcement Learning For Optimizing Route Planning In Urban Traffic	IEEE International Conference on "Computational, Communication and Information Technology", ICCCIT 2025 (2025)
18284	0.875	Korecki M.; Dailisan D.; Yang J.; Helbing D.	Democratizing Traffic Control In Smart Cities	Transportation Research Part C: Emerging Technologies, 160 (2024)
32025	0.874	Fatorachian H.; Kazemi H.	Integrating Learning-Based Solutions In Intelligent Transportation Systems: A Conceptual Framework And Case Studies Validation	Cogent Engineering, 11, 1 (2024)