Smart City Gnosys

Smart city article details

Title	Flow: A Modular Learning Framework For Mixed Autonomy Traffic
ID_Doc	26704
Authors	Wu C.; Kreidieh A.R.; Parvate K.; Vinitsky E.; Bayen A.M.
Year	2022
Published	IEEE Transactions on Robotics, 38, 2
DOI	http://dx.doi.org/10.1109/TRO.2021.3087314
Abstract	The rapid development of autonomous vehicles (AVs) holds vast potential for transportation systems through improved safety, efficiency, and access to mobility. However, the progression of these impacts, as AVs are adopted, is not well understood. Numerous technical challenges arise from the goal of analyzing the partial adoption of autonomy: partial control and observation, multivehicle interactions, and the sheer variety of scenarios represented by real-world networks. To shed light into near-term AV impacts, this article studies the suitability of deep reinforcement learning (RL) for overcoming these challenges in a low AV-adoption regime. A modular learning framework is presented, which leverages deep RL to address complex traffic dynamics. Modules are composed to capture common traffic phenomena (stop-and-go traffic jams, lane changing, intersections). Learned control laws are found to improve upon human driving performance, in terms of system-level velocity, by up to 57% with only 4-7% adoption of AVs. Furthermore, in single-lane traffic, a small neural network control law with only local observation is found to eliminate stop-and-go traffic - surpassing all known model-based controllers to achieve near-optimal performance - and generalize to out-of-distribution traffic densities. © 2004-2012 IEEE.
Author Keywords	Automation technologies for smart cities; deep learning in robotics and automation; deep reinforcement learning; intelligent transportation systems

Similar Articles

Id	Similarity	Authors	Title	Published
40923	0.905	Zhang Z.; Zhou B.; Zhang B.; Cheng P.; Lee D.-H.; Hu S.	Optimizing Traffic Signal Control In Mixed Traffic Scenarios: A Predictive Traffic Information-Based Deep Reinforcement Learning Approach	2024 Forum for Innovative Sustainable Transportation Systems, FISTS 2024 (2024)
23735	0.88	Sattarzadeh A.R.; Pathirana P.N.	Enhancing Adaptive Traffic Control Systems With Deep Reinforcement Learning And Graphical Models	Proceedings - 2024 IEEE International Conference on Future Machine Learning and Data Science, FMLDS 2024 (2024)
18049	0.878	Ashwin S.H.; Naveen Raj R.	Deep Reinforcement Learning For Autonomous Vehicles: Lane Keep And Overtaking Scenarios With Collision Avoidance	International Journal of Information Technology (Singapore), 15, 7 (2023)
6368	0.878	Dong Y.; Huang H.; Zhang G.; Jin J.	Adaptive Transit Signal Priority Control For Traffic Safety And Efficiency Optimization: A Multi-Objective Deep Reinforcement Learning Framework	Mathematics, 12, 24 (2024)
8559	0.878	Sahba A.; Sahba R.	An Intelligent System For Safely Managing Traffic Flow Of Connected Autonomous Vehicles At Multilane Intersections In Smart Cities	2022 IEEE 12th Annual Computing and Communication Workshop and Conference, CCWC 2022 (2022)
54026	0.877	Louati A.; Louati H.; Kariri E.; Neifar W.; Hassan M.K.; Khairi M.H.H.; Farahat M.A.; El-Hoseny H.M.	Sustainable Smart Cities Through Multi-Agent Reinforcement Learning-Based Cooperative Autonomous Vehicles	Sustainability (Switzerland) , 16, 5 (2024)
48908	0.871	Jang K.; Vinitsky E.; Chalaki B.; Remer B.; Beaver L.; Malikopoulos A.A.; Bayen A.	Simulation To Scaled City: Zero-Shot Policy Transfer For Traffic Control Via Autonomous Vehicles	ICCPS 2019 - Proceedings of the 2019 ACM/IEEE International Conference on Cyber-Physical Systems (2019)
32025	0.87	Fatorachian H.; Kazemi H.	Integrating Learning-Based Solutions In Intelligent Transportation Systems: A Conceptual Framework And Case Studies Validation	Cogent Engineering, 11, 1 (2024)
21429	0.868	Skoropad V.N.; Deđanski S.; Pantović V.; Injac Z.; Vujičić S.; Jovanović-Milenković M.; Jevtić B.; Lukić-Vujadinović V.; Vidojević D.; Bodolo I.	Dynamic Traffic Flow Optimization Using Reinforcement Learning And Predictive Analytics: A Sustainable Approach To Improving Urban Mobility In The City Of Belgrade	Sustainability (Switzerland), 17, 8 (2025)
6325	0.867	Ye Q.; Feng Y.; Macias J.J.E.; Stettler M.; Angeloudis P.	Adaptive Road Configurations For Improved Autonomous Vehicle-Pedestrian Interactions Using Reinforcement Learning	IEEE Transactions on Intelligent Transportation Systems, 24, 2 (2023)