Smart City Gnosys

Smart city article details

Title Exploring Reward Efficacy In Traffic Management Using Deep Reinforcement Learning In Intelligent Transportation System
ID_Doc 25605
Authors Paul A.; Mitra S.
Year 2022
Published ETRI Journal, 44, 2
DOI http://dx.doi.org/10.4218/etrij.2021-0404
Abstract In the last decade, substantial progress has been achieved in intelligent traffic control technologies to overcome consistent difficulties of traffic congestion and its adverse effect on smart cities. Edge computing is one such advanced progress facilitating real-time data transmission among vehicles and roadside units to mitigate congestion. An edge computing-based deep reinforcement learning system is demonstrated in this study that appropriately designs a multiobjective reward function for optimizing different objectives. The system seeks to overcome the challenge of evaluating actions with a simple numerical reward. The selection of reward functions has a significant impact on agents' ability to acquire the ideal behavior for managing multiple traffic signals in a large-scale road network. To ascertain effective reward functions, the agent is trained withusing the proximal policy optimization method in several deep neural network models, including the state-of-the-art transformer network. The system is verified using both hypothetical scenarios and real-world traffic maps. The comprehensive simulation outcomes demonstrate the potency of the suggested reward functions. 1225-6463/$ © 2022 ETRI.
Author Keywords DRL; edge computing; ITS; PPO; traffic signal


Similar Articles


Id Similarity Authors Title Published
10878 View0.916Egea A.C.; Howell S.; Knutins M.; Connaughton C.Assessment Of Reward Functions For Reinforcement Learning Traffic Signal Control Under Real-World LimitationsConference Proceedings - IEEE International Conference on Systems, Man and Cybernetics, 2020-October (2020)
23735 View0.9Sattarzadeh A.R.; Pathirana P.N.Enhancing Adaptive Traffic Control Systems With Deep Reinforcement Learning And Graphical ModelsProceedings - 2024 IEEE International Conference on Future Machine Learning and Data Science, FMLDS 2024 (2024)
40923 View0.898Zhang Z.; Zhou B.; Zhang B.; Cheng P.; Lee D.-H.; Hu S.Optimizing Traffic Signal Control In Mixed Traffic Scenarios: A Predictive Traffic Information-Based Deep Reinforcement Learning Approach2024 Forum for Innovative Sustainable Transportation Systems, FISTS 2024 (2024)
1391 View0.89Giannini F.; Franzè G.; Fortino G.; Pupo F.A Deep Reinforcement Learning Strategy For Intelligent Transportation SystemsInternet of Things, Part F1719 (2024)
32025 View0.889Fatorachian H.; Kazemi H.Integrating Learning-Based Solutions In Intelligent Transportation Systems: A Conceptual Framework And Case Studies ValidationCogent Engineering, 11, 1 (2024)
57625 View0.88Ait Ouallane A.; Bahnasse A.; Bakali A.; Talea M.Toward A Smart City: Reinforcement Learning For Traffic Light ControlLecture Notes in Networks and Systems, 629 LNNS (2023)
44895 View0.88Barta Z.; Kovács S.; Botzheim J.Reinforcement Learning-Based Cooperative Traffic Control SystemLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 14811 LNAI (2024)
11516 View0.879Giannini F.; Franze G.; Pupo F.; Fortino G.Autonomous Vehicles In Smart Cities: A Deep Reinforcement Learning SolutionProceedings of the 2022 IEEE International Conference on Dependable, Autonomic and Secure Computing, International Conference on Pervasive Intelligence and Computing, International Conference on Cloud and Big Data Computing, International Conference on Cyber Science and Technology Congress, DASC/PiCom/CBDCom/CyberSciTech 2022 (2022)
33264 View0.878Reda M.; Mountassir F.; Mohamed B.Introduction To Coordinated Deep Agents For Traffic Signal2019 International Conference on Wireless Technologies, Embedded and Intelligent Systems, WITS 2019 (2019)
58613 View0.878Paduraru C.; Paduraru M.; Stefanescu A.Traffic Light Control Using Reinforcement Learning: A Survey And An Open Source ImplementationInternational Conference on Vehicle Technology and Intelligent Transport Systems, VEHITS - Proceedings (2022)