Smart City Gnosys
Smart city article details
| Title | Adaptive Traffic Management In Smart Cities Using Deep Reinforcement Learning For Iot Mobile Ad Hoc Networks |
|---|---|
| ID_Doc | 6359 |
| Authors | Rao P.S.V.S.; Bhadula S.; Balasubramani R.; Suryawanshi P.B.; Yadav A.K.; Vekariya D. |
| Year | 2024 |
| Published | 2nd International Conference on Intelligent Cyber Physical Systems and Internet of Things, ICoICI 2024 - Proceedings |
| DOI | http://dx.doi.org/10.1109/ICoICI62503.2024.10696734 |
| Abstract | This research evaluates four Deep Reinforcement Learning (DRL) algorithms-TD3, SAC, Rainbow DQN, and TRPO-for their effectiveness in adaptive traffic management, specifically in optimizing parking space management in smart cities. The algorithms were assessed based on key performance metrics: TD3 achieved a reward score of 85.6 with Actor Loss of 0.023, Critic Loss of 0.041, and 72 hours of training time. SAC outperformed with a reward score of 88.2, Actor Loss of 0.018, Critic Loss of 0.035, and 68 hours of training. Rainbow DQN achieved a competitive reward score of 87.4, Q-value of 0.075, Loss of 0.027, and 80 hours of training. TRPO attained a reward score of 86.8, Policy Loss of 0.032, Value Function Loss of 0.021, and 75 hours of training. SAC has shown best performance across the board, achieving a good exploration and exploitation trade-off. While Rainbow DQN can be seen excelling on tasks with discrete action spaces, the TD3 and TRPO clearly outperformed the others from continuous control task performance and a robust stable policy update of following iterations perspective respectively. The results show that SAC had the best overall performance with demonstrating a good trade-off between exploration and exploitation. While Rainbow DQN was robust to dilution in discrete action spaces, TD3 and TRPO performed well on continuous control tasks and stable policy updates respectively. These results give further evidence to the potential of DRL for real-world applications, such as dynamically assigning parking slots and directing traffic in cities towards efficient city-wide mobility. Future research may examine the further integration of real-time IoT data and increased scalability for citywide implementations to deliver smarter, more adaptive, traffic management solutions that account for the complexities of today's urban areas. © 2024 IEEE. |
| Author Keywords | adaptive traffic management; deep reinforcement learning; IoT integration; parking space optimization; smart cities |
Similar Articles
| Id | Similarity | Authors | Title | Published |
|---|---|---|---|---|
18053  | 0.915 | Kansal V.; Shnain A.H.; Deepak A.; Rana A.; Manjunatha; Dixit K.K.; Rajkumar K.V. | Deep Reinforcement Learning For Iot-Based Smart Traffic Management Systems | Proceedings of International Conference on Contemporary Computing and Informatics, IC3I 2024 (2024) |
| 18032 | 0.905 | Singh D. | Deep Reinforcement Learning (Drl) For Real-Time Traffic Management In Smart Cities | 2023 International Conference on Communication, Security and Artificial Intelligence, ICCSAI 2023 (2023) |
| 18057 | 0.895 | Mittal M.; Sehgal A.; Varshney N.; Kumar S.P.; Boob N.S.; Reddy R.A. | Deep Reinforcement Learning For Optimizing Route Planning In Urban Traffic | IEEE International Conference on "Computational, Communication and Information Technology", ICCCIT 2025 (2025) |
| 6356 | 0.893 | Kumar R.; Sharma N.V.K.; Chaurasiya V.K. | Adaptive Traffic Light Control Using Deep Reinforcement Learning Technique | Multimedia Tools and Applications, 83, 5 (2024) |
| 60077 | 0.891 | Ranganathan C.S.; Jayanthi L.N.; Babu J.J.; Manikandan M.; Sivakamy N. | Urban Mobility Optimization With Iot And Deep Q Networks For Traffic Density Management | 2024 3rd International Conference for Innovation in Technology, INOCON 2024 (2024) |
| 23735 | 0.89 | Sattarzadeh A.R.; Pathirana P.N. | Enhancing Adaptive Traffic Control Systems With Deep Reinforcement Learning And Graphical Models | Proceedings - 2024 IEEE International Conference on Future Machine Learning and Data Science, FMLDS 2024 (2024) |
| 6730 | 0.884 | Qu A.; Tang Y.; Ma W. | Adversarial Attacks On Deep Reinforcement Learning-Based Traffic Signal Control Systems With Colluding Vehicles | ACM Transactions on Intelligent Systems and Technology, 14, 6 (2023) |
| 23240 | 0.877 | Dhanvijay M.M.; Patil S.C. | Energy Efficient Deep Reinforcement Learning Approach To Control The Traffic Flow In Iot Networks For Smart City | Journal of Ambient Intelligence and Humanized Computing, 15, 12 (2024) |
| 11516 | 0.876 | Giannini F.; Franze G.; Pupo F.; Fortino G. | Autonomous Vehicles In Smart Cities: A Deep Reinforcement Learning Solution | Proceedings of the 2022 IEEE International Conference on Dependable, Autonomic and Secure Computing, International Conference on Pervasive Intelligence and Computing, International Conference on Cloud and Big Data Computing, International Conference on Cyber Science and Technology Congress, DASC/PiCom/CBDCom/CyberSciTech 2022 (2022) |
| 32025 | 0.875 | Fatorachian H.; Kazemi H. | Integrating Learning-Based Solutions In Intelligent Transportation Systems: A Conceptual Framework And Case Studies Validation | Cogent Engineering, 11, 1 (2024) |