Smart City Gnosys

Smart city article details

Title Reinforcement Learning-Based Routing Protocols In Vehicular And Flying Ad Hoc Networks – A Literature Survey; [Protokoli Rutiranja Bazirani Na Učenju Potkrepljivanjem Za Bežične Ad Hoc Mreže Za Vozila I Bespilotne Letelice – Pregled Literature]
ID_Doc 44899
Authors Bugarčić P.; Jevtić N.; Malnar M.
Year 2022
Published Promet - Traffic and Transportation, 34, 6
DOI http://dx.doi.org/10.7307/ptt.v34i6.4159
Abstract Vehicular and flying ad hoc networks (VANETs and FANETs) are becoming increasingly important with the development of smart cities and intelligent transportation systems (ITSs). The high mobility of nodes in these networks leads to frequent link breaks, which complicates the discovery of optimal route from source to destination and degrades network performance. One way to overcome this problem is to use machine learning (ML) in the routing process, and the most promising among different ML types is reinforcement learning (RL). Although there are several surveys on RL-based routing protocols for VANETs and FANETs, an important issue of integrating RL with well-established modern technologies, such as software-defined networking (SDN) or blockchain, has not been adequately addressed, especially when used in complex ITSs. In this paper, we focus on performing a comprehensive categorisation of RL-based routing protocols for both network types, having in mind their simultaneous use and the inclusion with other technologies. A detailed comparative analysis of protocols is carried out based on different factors that influence the reward function in RL and the consequences they have on network performance. Also, the key advantages and limitations of RL-based routing are discussed in detail. © 2022, Faculty of Transport and Traffic Engineering. All rights reserved.
Author Keywords FANET; ITS; Q-learning; reinforcement learning; routing protocols; VANET


Similar Articles


Id Similarity Authors Title Published
44881 View0.908Teixeira L.H.; Huszák Á.Reinforcement Learning Environment For Advanced Vehicular Ad Hoc Networks Communication SystemsSensors, 22, 13 (2022)
46607 View0.886Salama R.; Alturjman S.; Altrjman C.; Al-Turjman F.Reward-Based Energy-Aware Routing Protocols In Wireless Sensor NetworksSustainable Civil Infrastructures (2024)
21132 View0.87Cárdenas L.L.; Mezher A.M.; León J.P.A.; Igartua M.A.Dtmr: A Decision Tree-Based Multimetric Routing Protocol For Vehicular Ad Hoc NetworksPE-WASUN 2021 - Proceedings of the 18th ACM Symposium on Performance Evaluation of Wireless Ad Hoc, Sensor, and Ubiquitous Networks (2021)
28309 View0.866Cárdenas L.L.; León J.P.A.; Mezher A.M.Gratree: A Gradient Boosting Decision Tree Based Multimetric Routing Protocol For Vehicular Ad Hoc NetworksAd Hoc Networks, 137 (2022)
1391 View0.863Giannini F.; Franzè G.; Fortino G.; Pupo F.A Deep Reinforcement Learning Strategy For Intelligent Transportation SystemsInternet of Things, Part F1719 (2024)
6359 View0.863Rao P.S.V.S.; Bhadula S.; Balasubramani R.; Suryawanshi P.B.; Yadav A.K.; Vekariya D.Adaptive Traffic Management In Smart Cities Using Deep Reinforcement Learning For Iot Mobile Ad Hoc Networks2nd International Conference on Intelligent Cyber Physical Systems and Internet of Things, ICoICI 2024 - Proceedings (2024)
18057 View0.862Mittal M.; Sehgal A.; Varshney N.; Kumar S.P.; Boob N.S.; Reddy R.A.Deep Reinforcement Learning For Optimizing Route Planning In Urban TrafficIEEE International Conference on "Computational, Communication and Information Technology", ICCCIT 2025 (2025)
35024 View0.861Jaleel U.; Lalmawipuii R.Leveraging Ai And Blockchain In Manets To Enhance Smart City Infrastructure And Autonomous Vehicular NetworksApplications of Mathematics in Science and Technology: International Conference on Mathematical Applications in Science and Technology (2025)
21064 View0.861Nguyen H.T.T.; Nguyen M.T.; Do H.T.; Hua H.T.; Nguyen C.V.Drl-Based Intelligent Resource Allocation For Diverse Qos In 5G And Toward 6G Vehicular Networks: A Comprehensive SurveyWireless Communications and Mobile Computing, 2021 (2021)
48981 View0.859Ornelas-Gutierrez A.; Vargas-Rosales C.; Villalpando-Hernandez R.; Zuniga-Mejia J.Sinr Management In Roundabout Vehicular Ad Hoc Networks: A Control And Reinforcement Learning With Digital Beamforming ApproachIEEE Access, 12 (2024)