Smart City Gnosys
Smart city article details
| Title | Sustainable Smart Cities Through Multi-Agent Reinforcement Learning-Based Cooperative Autonomous Vehicles |
|---|---|
| ID_Doc | 54026 |
| Authors | Louati A.; Louati H.; Kariri E.; Neifar W.; Hassan M.K.; Khairi M.H.H.; Farahat M.A.; El-Hoseny H.M. |
| Year | 2024 |
| Published | Sustainability (Switzerland) , 16, 5 |
| DOI | http://dx.doi.org/10.3390/su16051779 |
| Abstract | As urban centers evolve into smart cities, sustainable mobility emerges as a cornerstone for ensuring environmental integrity and enhancing quality of life. Autonomous vehicles (AVs) play a pivotal role in this transformation, with the potential to significantly improve efficiency and safety, and reduce environmental impacts. This study introduces a novel Multi-Agent Actor–Critic (MA2C) algorithm tailored for multi-AV lane-changing in mixed-traffic scenarios, a critical component of intelligent transportation systems in smart cities. By incorporating a local reward system that values efficiency, safety, and passenger comfort, and a parameter-sharing scheme that encourages inter-agent collaboration, our MA2C algorithm presents a comprehensive approach to urban traffic management. The MA2C algorithm leverages reinforcement learning to optimize lane-changing decisions, ensuring optimal traffic flow and enhancing both environmental sustainability and urban living standards. The actor–critic architecture is refined to minimize variances in urban traffic conditions, enhancing predictability and safety. The study extends to simulating realistic human-driven vehicle (HDV) behavior using the Intelligent Driver Model (IDM) and the model of Minimizing Overall Braking Induced by Lane changes (MOBIL), contributing to more accurate and effective traffic management strategies. Empirical results indicate that the MA2C algorithm outperforms existing state-of-the-art models in managing lane changes, passenger comfort, and inter-vehicle cooperation, essential for the dynamic environment of smart cities. The success of the MA2C algorithm in facilitating seamless interaction between AVs and HDVs holds promise for more fluid urban traffic conditions, reduced congestion, and lower emissions. This research contributes to the growing body of knowledge on autonomous driving within the framework of sustainable smart cities, focusing on the integration of AVs into the urban fabric. It underscores the potential of machine learning and artificial intelligence in developing transportation systems that are not only efficient and safe but also sustainable, supporting the broader goals of creating resilient, adaptive, and environmentally friendly urban spaces. © 2024 by the authors. |
| Author Keywords | autonomous vehicles; multi-agent; reinforcement learning; smart city mobility; urban sustainability |
Similar Articles
| Id | Similarity | Authors | Title | Published |
|---|---|---|---|---|
50634  | 0.906 | Ahmadi K.; Allan V.H. | Smart City: Application Of Multi-Agent Reinforcement Learning Systems In Adaptive Traffic Management | 2021 IEEE International Smart Cities Conference, ISC2 2021 (2021) |
| 21429 | 0.888 | Skoropad V.N.; Deđanski S.; Pantović V.; Injac Z.; Vujičić S.; Jovanović-Milenković M.; Jevtić B.; Lukić-Vujadinović V.; Vidojević D.; Bodolo I. | Dynamic Traffic Flow Optimization Using Reinforcement Learning And Predictive Analytics: A Sustainable Approach To Improving Urban Mobility In The City Of Belgrade | Sustainability (Switzerland), 17, 8 (2025) |
| 38482 | 0.887 | Shynkar Y.; Raja A.; Bazzan A.L.C.; Marinov M. | Multiagent Meta-Level Control For Adaptive Traffic Systems: A Case Study | Transportation Research Procedia, 62 (2022) |
| 40923 | 0.886 | Zhang Z.; Zhou B.; Zhang B.; Cheng P.; Lee D.-H.; Hu S. | Optimizing Traffic Signal Control In Mixed Traffic Scenarios: A Predictive Traffic Information-Based Deep Reinforcement Learning Approach | 2024 Forum for Innovative Sustainable Transportation Systems, FISTS 2024 (2024) |
| 18284 | 0.878 | Korecki M.; Dailisan D.; Yang J.; Helbing D. | Democratizing Traffic Control In Smart Cities | Transportation Research Part C: Emerging Technologies, 160 (2024) |
| 56108 | 0.878 | Matowicki M.; Pribyl O. | The Need For Balanced Policies Integrating Autonomous Vehicles In Cities | 2020 Smart Cities Symposium Prague, SCSP 2020 (2020) |
| 8536 | 0.878 | Chen, C; Zhang, YR; Khosravi, MR; Pei, QQ; Wan, SH | An Intelligent Platooning Algorithm For Sustainable Transportation Systems In Smart Cities | IEEE SENSORS JOURNAL, 21, 14 (2021) |
| 26704 | 0.877 | Wu C.; Kreidieh A.R.; Parvate K.; Vinitsky E.; Bayen A.M. | Flow: A Modular Learning Framework For Mixed Autonomy Traffic | IEEE Transactions on Robotics, 38, 2 (2022) |
| 38873 | 0.877 | Al-Kaff A. | Navigating The Future: Ai Innovations For Intelligent Mobility In Smart Cities | SAE Technical Papers (2023) |
| 4034 | 0.876 | Wang E.; Memar F.H.; Korzelius S.; Sadek A.W.; Qiao C. | A Reinforcement Learning Approach To Cav And Intersection Control For Energy Efficiency | Proceedings - 2022 5th International Conference on Connected and Autonomous Driving, MetroCAD 2022 (2022) |