Smart City Gnosys

Smart city article details

Title A Q-Learning-Based Approximate Solving Algorithm For Vehicular Route Game
ID_Doc 3904
Authors Zhang L.; Lyu L.; Zheng S.; Ding L.; Xu L.
Year 2022
Published Sustainability (Switzerland), 14, 19
DOI http://dx.doi.org/10.3390/su141912033
Abstract Route game is recognized as an effective method to alleviate Braess’ paradox, which generates a new traffic congestion since numerous vehicles obey the same guidance from the selfish route guidance (such as Google Maps). The conventional route games have symmetry since vehicles’ payoffs depend only on the selected route distribution but not who chose, which leads to the precise Nash equilibrium being able to be solved by constructing a special potential function. However, with the arrival of smart cities, the real-time of route schemes is more of a concerned of engineers than the absolute optimality in real traffic. It is not an easy task to re-construct the new potential functions of the route games due to the dynamic traffic conditions. In this paper, compared with the hard-solvable potential function-based precise method, a matched Q-learning algorithm is designed to generate the approximate Nash equilibrium of the classic route game for real-time traffic. An experimental study shows that the Nash equilibrium coefficients generated by the Q-learning-based approximate solving algorithm all converge to 1.00, and still have the required convergence in the different traffic parameters. © 2022 by the authors.
Author Keywords approximate Nash equilibrium; Braess’ paradox; Q-learning; route game; traffic congestion


Similar Articles


Id Similarity Authors Title Published
17658 View0.865Bastianello N.; Badia L.Decentralized Intersection Control Using Bayesian Game TheoryProceedings - ISMODE 2022: 2nd International Seminar on Machine Learning, Optimization, and Data Science (2022)
3902 View0.854Rahmani A.M.; Naqvi R.A.; Yousefpoor E.; Yousefpoor M.S.; Ahmed O.H.; Hosseinzadeh M.; Siddique K.A Q-Learning And Fuzzy Logic-Based Hierarchical Routing Scheme In The Intelligent Transportation System For Smart CitiesMathematics, 10, 22 (2022)
21386 View0.852Wang J.; Wei J.; Chen S.; Yu H.; Ren Y.Dynamic Route Optimization For Multi-Vehicle Systems With Diverse Needs In Road Networks Based On Preference GamesComputers, Materials and Continua, 83, 3 (2025)