Smart City Gnosys

Smart city article details

Title Adversarial Attacks On Deep Reinforcement Learning-Based Traffic Signal Control Systems With Colluding Vehicles
ID_Doc 6730
Authors Qu A.; Tang Y.; Ma W.
Year 2023
Published ACM Transactions on Intelligent Systems and Technology, 14, 6
DOI http://dx.doi.org/10.1145/3625236
Abstract The rapid advancements of Internet of Things (IoT) and Artificial Intelligence (AI) have catalyzed the development of adaptive traffic control systems (ATCS) for smart cities. In particular, deep reinforcement learning (DRL) models produce state-of-The-Art performance and have great potential for practical applications. In the existing DRL-based ATCS, the controlled signals collect traffic state information from nearby vehicles, and then optimal actions (e.g., switching phases) can be determined based on the collected information. The DRL models fully "trust"that vehicles are sending the true information to the traffic signals, making the ATCS vulnerable to adversarial attacks with falsified information. In view of this, this article first time formulates a novel task in which a group of vehicles can cooperatively send falsified information to "cheat"DRL-based ATCS in order to save their total travel time. To solve the proposed task, we develop CollusionVeh, a generic and effective vehicle-colluding framework composed of a road situation encoder, a vehicle interpreter, and a communication mechanism. We employ our framework to attack established DRL-based ATCS and demonstrate that the total travel time for the colluding vehicles can be significantly reduced with a reasonable number of learning episodes, and the colluding effect will decrease if the number of colluding vehicles increases. Additionally, insights and suggestions for the real-world deployment of DRL-based ATCS are provided. The research outcomes could help improve the reliability and robustness of the ATCS and better protect the smart mobility systems. © 2023 Copyright held by the owner/author(s). Publication rights licensed to ACM.
Author Keywords adaptive traffic control system; Adversarial attacks; connected vehicles; reinforcement learning


Similar Articles


Id Similarity Authors Title Published
23735 View0.899Sattarzadeh A.R.; Pathirana P.N.Enhancing Adaptive Traffic Control Systems With Deep Reinforcement Learning And Graphical ModelsProceedings - 2024 IEEE International Conference on Future Machine Learning and Data Science, FMLDS 2024 (2024)
18053 View0.899Kansal V.; Shnain A.H.; Deepak A.; Rana A.; Manjunatha; Dixit K.K.; Rajkumar K.V.Deep Reinforcement Learning For Iot-Based Smart Traffic Management SystemsProceedings of International Conference on Contemporary Computing and Informatics, IC3I 2024 (2024)
18032 View0.885Singh D.Deep Reinforcement Learning (Drl) For Real-Time Traffic Management In Smart Cities2023 International Conference on Communication, Security and Artificial Intelligence, ICCSAI 2023 (2023)
6359 View0.884Rao P.S.V.S.; Bhadula S.; Balasubramani R.; Suryawanshi P.B.; Yadav A.K.; Vekariya D.Adaptive Traffic Management In Smart Cities Using Deep Reinforcement Learning For Iot Mobile Ad Hoc Networks2nd International Conference on Intelligent Cyber Physical Systems and Internet of Things, ICoICI 2024 - Proceedings (2024)
18057 View0.883Mittal M.; Sehgal A.; Varshney N.; Kumar S.P.; Boob N.S.; Reddy R.A.Deep Reinforcement Learning For Optimizing Route Planning In Urban TrafficIEEE International Conference on "Computational, Communication and Information Technology", ICCCIT 2025 (2025)
21830 View0.882Zhang L.; Zhou Z.; Yi B.; Wang J.; Chen C.-M.; Shi C.Edge-Cloud Framework For Vehicle-Road Cooperative Traffic Signal Control In Augmented Internet Of ThingsIEEE Internet of Things Journal, 12, 5 (2025)
24038 View0.874Vieira M.A.; Galvão G.; Vieira M.; Véstias M.; Louro P.; Jardim-Goncalves R.Enhancing Traffic Flow With Visible Light Communication: A Deep Reinforcement Learning ApproachProceedings of SPIE - The International Society for Optical Engineering, 13374 (2025)
47813 View0.873Jain R.; Tihanyi N.; Ferrag M.A.Securing Tomorrow’S Smart Cities: Investigating Software Security In Internet Of Vehicles And Deep Learning TechnologiesLecture Notes in Intelligent Transportation and Infrastructure, Part F99 (2025)
15627 View0.873Sachan A.; Chauhan N.S.; Kumar N.Congestion Minimization Using Fog-Deployed Drl-Agent Feedback Enabled Traffic Light Cooperative FrameworkProceedings - 23rd IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing, CCGrid 2023 (2023)
6368 View0.871Dong Y.; Huang H.; Zhang G.; Jin J.Adaptive Transit Signal Priority Control For Traffic Safety And Efficiency Optimization: A Multi-Objective Deep Reinforcement Learning FrameworkMathematics, 12, 24 (2024)