Smart City Gnosys

Smart city article details

Title Optimizing Electric Vehicle Charging Recommendation In Smart Cities: A Multi-Agent Reinforcement Learning Approach
ID_Doc 40790
Authors Suanpang P.; Jamjuntr P.
Year 2024
Published World Electric Vehicle Journal, 15, 2
DOI http://dx.doi.org/10.3390/wevj15020067
Abstract As global awareness for preserving natural energy sustainability rises, electric vehicles (EVs) are increasingly becoming a preferred choice for transportation because of their ability to emit zero emissions, conserve energy, and reduce pollution, especially in smart cities with sustainable development. Nonetheless, the lack of adequate EV charging infrastructure remains a significant problem that has resulted in varying charging demands at different locations and times, particularly in developing countries. As a consequence, this inadequacy has posed a challenge for EV drivers, particularly those in smart cities, as they face difficulty in locating suitable charging stations. Nevertheless, the recent development of deep reinforcement learning is a promising technology that has the potential to improve the charging experience in several ways over the long term. This paper proposes a novel approach for recommending EV charging stations using multi-agent reinforcement learning (MARL) algorithms by comparing several popular algorithms, including the deep deterministic policy gradient, deep Q-network, multi-agent DDPG (MADDPG), Real, and Random, in optimizing the placement and allocation of the EV charging stations. The results demonstrated that MADDPG outperformed other algorithms in terms of the Mean Charge Waiting Time, CFT, and Total Saving Fee, thus indicating its superiority in addressing the EV charging station problem in a multi-agent setting. The collaborative and communicative nature of the MADDPG algorithm played a key role in achieving these results. Hence, this approach could provide a better user experience, increase the adoption of EVs, and be extended to other transportation-related problems. Overall, this study highlighted the potential of MARL as a powerful approach for solving complex optimization problems in transportation and beyond. This would also contribute to the development of more efficient and sustainable transportation systems in smart cities for sustainable development. © 2024 by the authors.
Author Keywords charge station; electric vehicle; multi-agent reinforcement learning; optimizing; recommendation systems; smart cities


Similar Articles


Id Similarity Authors Title Published
38088 View0.948Bachiri K.; Yahyaouy A.; Gualous H.; Malek M.; Bennani Y.; Makany P.; Rogovschi N.Multi-Agent Ddpg Based Electric Vehicles Charging Station RecommendationEnergies, 16, 16 (2023)
8542 View0.939Suanpang P.; Jamjuntr P.; Kaewyong P.; Niamsorn C.; Jermsittiparsert K.An Intelligent Recommendation For Intelligently Accessible Charging Stations: Electronic Vehicle Charging To Support A Sustainable Smart Tourism CitySustainability (Switzerland), 15, 1 (2023)
7022 View0.912Khan A.A.; Mahendran R.K.; Ullah F.; Ali F.; Bashir A.K.; Dabel M.M.A.; Omar M.Ai-Driven Dynamic Allocation And Management Optimization For Ev Charging StationsIEEE Transactions on Intelligent Transportation Systems (2025)
35913 View0.912Shahriar S.; Al-Ali A.R.; Osman A.H.; Dhou S.; Nijim M.Machine Learning Approaches For Ev Charging Behavior: A ReviewIEEE Access, 8 (2020)
48723 View0.912Jin J.; Xu Y.Shortest-Path-Based Deep Reinforcement Learning For Ev Charging Routing Under Stochastic Traffic Condition And Electricity PricesIEEE Internet of Things Journal, 9, 22 (2022)
4042 View0.907Pan S.; Maity S.P.; Ioannou I.I.; Vassiliou V.; Adhvaryu K.A Reinforcement Learning-Based Strategy For The Optimal Placement Of Electric Vehicle Charging Stations In Smart City For Urban Planning2024 Asian Conference on Communication and Networks, ASIANComNet 2024 (2024)
51245 View0.897Raja G.; Saravanan G.; Prathiba S.B.; Akhtar Z.; Ali Khowaja S.; Dev K.Smart Navigation And Energy Management Framework For Autonomous Electric Vehicles In Complex EnvironmentsIEEE Internet of Things Journal, 10, 21 (2023)
40791 View0.893Zhao X.; Liang G.Optimizing Electric Vehicle Charging Schedules And Energy Management In Smart Grids Using An Integrated Ga-Gru-Rl ApproachFrontiers in Energy Research, 11 (2023)
38094 View0.889Pok P.J.; Yeo H.; Woo S.Multi-Agent Game-Theoretic Modelling Of Electric Vehicle Charging Behavior And Pricing Optimization In Dynamic EcosystemsProcedia Computer Science, 257 (2025)
22524 View0.887Doda D.K.; Beemkumar N.; Awasthi A.; Gautam A.K.Electric Vehicle Energy Management: Charging In Sustainable Urban Settings For Smart CitiesE3S Web of Conferences, 540 (2024)