Smart City Gnosys

Smart city article details

Title	Shortest-Path-Based Deep Reinforcement Learning For Ev Charging Routing Under Stochastic Traffic Condition And Electricity Prices
ID_Doc	48723
Authors	Jin J.; Xu Y.
Year	2022
Published	IEEE Internet of Things Journal, 9, 22
DOI	http://dx.doi.org/10.1109/JIOT.2022.3181613
Abstract	We study the charging routing problem faced by a smart electric vehicle (EV) that looks for an EV charging station (EVCS) to fulfill its battery charging demand. Leveraging the real-time information from both the power and intelligent transportation systems, the EV seeks to minimize the sum of the travel cost (to a selected EVCS) and the charging cost (a weighted sum of electricity cost and waiting time cost at the EVCS). We formulate the problem as a Markov decision process with unknown dynamics of system uncertainties (in traffic conditions, charging prices, and waiting time). To mitigate the curse of dimensionality, we reformulate the deterministic charging routing problem (a mixed-integer program) as a two-level shortest-path (SP)-based optimization problem that can be solved in polynomial time. Its low dimensional solution is input into a state-of-the-art deep reinforcement learning (DRL) algorithm, the advantage actor-critic (A2C) method, to make efficient online routing decisions. Numerical results (on a real-world transportation network) demonstrate that the proposed SP-based A2C approach outperforms the classical A2C method and two alternative SP-based DRL methods. © 2014 IEEE.
Author Keywords	Deep reinforcement learning (DRL); electric vehicle (EV) charging routing; Markov decision process (MDP); shortest path (SP); smart city

Similar Articles

Id	Similarity	Authors	Title	Published
40790	0.912	Suanpang P.; Jamjuntr P.	Optimizing Electric Vehicle Charging Recommendation In Smart Cities: A Multi-Agent Reinforcement Learning Approach	World Electric Vehicle Journal, 15, 2 (2024)
37118	0.906	Si C.; Hou Y.; Liu W.; Chau K.T.	Mirror-Symmetrical Dijkstra’S Algorithm-Based Deep Reinforcement Learning For Dynamic Wireless Charging Navigation Of Electric Vehicles	IEEE Internet of Things Journal (2025)
38088	0.905	Bachiri K.; Yahyaouy A.; Gualous H.; Malek M.; Bennani Y.; Makany P.; Rogovschi N.	Multi-Agent Ddpg Based Electric Vehicles Charging Station Recommendation	Energies, 16, 16 (2023)
7022	0.895	Khan A.A.; Mahendran R.K.; Ullah F.; Ali F.; Bashir A.K.; Dabel M.M.A.; Omar M.	Ai-Driven Dynamic Allocation And Management Optimization For Ev Charging Stations	IEEE Transactions on Intelligent Transportation Systems (2025)
8542	0.892	Suanpang P.; Jamjuntr P.; Kaewyong P.; Niamsorn C.; Jermsittiparsert K.	An Intelligent Recommendation For Intelligently Accessible Charging Stations: Electronic Vehicle Charging To Support A Sustainable Smart Tourism City	Sustainability (Switzerland), 15, 1 (2023)
51245	0.879	Raja G.; Saravanan G.; Prathiba S.B.; Akhtar Z.; Ali Khowaja S.; Dev K.	Smart Navigation And Energy Management Framework For Autonomous Electric Vehicles In Complex Environments	IEEE Internet of Things Journal, 10, 21 (2023)
44356	0.879	Faghri S.; Tahami H.; Amini R.; Katiraee H.; Godazi Langeroudi A.S.; Alinejad M.; Ghasempour Nejati M.	Real-Time Energy Flexibility Optimization Of Grid-Connected Smart Building Communities With Deep Reinforcement Learning	Sustainable Cities and Society, 119 (2025)
35913	0.878	Shahriar S.; Al-Ali A.R.; Osman A.H.; Dhou S.; Nijim M.	Machine Learning Approaches For Ev Charging Behavior: A Review	IEEE Access, 8 (2020)
40791	0.874	Zhao X.; Liang G.	Optimizing Electric Vehicle Charging Schedules And Energy Management In Smart Grids Using An Integrated Ga-Gru-Rl Approach	Frontiers in Energy Research, 11 (2023)
38094	0.866	Pok P.J.; Yeo H.; Woo S.	Multi-Agent Game-Theoretic Modelling Of Electric Vehicle Charging Behavior And Pricing Optimization In Dynamic Ecosystems	Procedia Computer Science, 257 (2025)