Smart City Gnosys
Smart city article details
| Title | A Reinforcement Learning Approach To Cav And Intersection Control For Energy Efficiency |
|---|---|
| ID_Doc | 4034 |
| Authors | Wang E.; Memar F.H.; Korzelius S.; Sadek A.W.; Qiao C. |
| Year | 2022 |
| Published | Proceedings - 2022 5th International Conference on Connected and Autonomous Driving, MetroCAD 2022 |
| DOI | http://dx.doi.org/10.1109/MetroCAD56305.2022.00016 |
| Abstract | The advent of intelligent Connected Autonomous Vehicles (CAVs), smart traffic control infrastructure, and Vehicle-to-Infrastructure (V2I) communication provide many opportunities to increase energy efficiency while minimizing the waiting time at signalled intersections, even though only some vehicles are CAVs and the others are human-driven. Unlike the traditional approaches using Model Predictive Control (MPC) that rely on manually designing speed control strategies, this paper proposes a reinforcement learning-based method, named Energy Efficiency Intersection Control and CAVs' speed control (E2-ICCAV). More specifically, the method consists of a manager module for the intersection and a worker module for each CAV. The manager module focuses on learning about the phase selections of the intersection to minimize all vehicles' waiting time and energy consumption. To achieve this end, we adopt an options framework for the manager module and empower it to choose reasonable phases and maintain them for a reasonable period. In the worker module, we regard each CAV as a worker and formulate CAVs' speed control problem as a Markov game. Each worker aims to minimize both hard accelerations and braking, while always keeping a safe distance from the leading vehicle. The evaluation results show that the proposed E2-ICCAV method can achieve the shortest waiting time and queue length as well as the fewest hard accelerations and braking. In addition, we have developed an infrastructure-assisted eco-drive automated driving system using a real-world test bed which is a proof-of-concept for large scale intersection control in smart cities. © 2022 IEEE. |
| Author Keywords | Connected Autonomous Vehicles; Energy Efficiency; Vehicle-to-Infrastructure Communication |
Similar Articles
| Id | Similarity | Authors | Title | Published |
|---|---|---|---|---|
19441  | 0.895 | Chen H.; Rakha H.A.; Wang J. | Developing And Testing A Smart City Signalized Eco-Cooperative Adaptive Cruise Control System | 2024 IEEE International Conference on Smart Mobility, SM 2024 (2024) |
| 40923 | 0.888 | Zhang Z.; Zhou B.; Zhang B.; Cheng P.; Lee D.-H.; Hu S. | Optimizing Traffic Signal Control In Mixed Traffic Scenarios: A Predictive Traffic Information-Based Deep Reinforcement Learning Approach | 2024 Forum for Innovative Sustainable Transportation Systems, FISTS 2024 (2024) |
| 4724 | 0.88 | Chen H.; Rakha H.A. | A Smart City Signalized Eco-Cooperative Adaptive Cruise Control And Multi-Objective Dynamic Routing System | 2022 IEEE International Conference on Smart Mobility, SM 2022 (2022) |
| 2234 | 0.876 | Chalaki B.; Malikopoulos A.A. | A Hysteretic Q-Learning Coordination Framework For Emerging Mobility Systems In Smart Cities | 2021 European Control Conference, ECC 2021 (2021) |
| 54026 | 0.876 | Louati A.; Louati H.; Kariri E.; Neifar W.; Hassan M.K.; Khairi M.H.H.; Farahat M.A.; El-Hoseny H.M. | Sustainable Smart Cities Through Multi-Agent Reinforcement Learning-Based Cooperative Autonomous Vehicles | Sustainability (Switzerland) , 16, 5 (2024) |
| 51098 | 0.874 | Khanmohamadi M.; Guerrieri M. | Smart Intersections And Connected Autonomous Vehicles For Sustainable Smart Cities: A Brief Review | Sustainability (Switzerland), 17, 7 (2025) |
| 25210 | 0.872 | Li W.; Rios-Torres J.; Wang B.; Khattak Z.H. | Experimental Assessment Of Communication Delay'S Impact On Connected Automated Vehicle Speed Volatility And Energy Consumption | Communications in Transportation Research, 4 (2024) |
| 25323 | 0.872 | Chalaki B.; Beaver L.E.; Malikopoulos A.A. | Experimental Validation Of A Real-Time Optimal Controller For Coordination Of Cavs In A Multi-Lane Roundabout | IEEE Intelligent Vehicles Symposium, Proceedings (2020) |
| 57625 | 0.871 | Ait Ouallane A.; Bahnasse A.; Bakali A.; Talea M. | Toward A Smart City: Reinforcement Learning For Traffic Light Control | Lecture Notes in Networks and Systems, 629 LNNS (2023) |
| 44895 | 0.87 | Barta Z.; Kovács S.; Botzheim J. | Reinforcement Learning-Based Cooperative Traffic Control System | Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 14811 LNAI (2024) |