Smart City Gnosys

Smart city article details

Title Distributed Reinforcement Learning Framework For Collaborative Energy Management In Connected Hybrid Electric Vehicle Ecosystems
ID_Doc 20702
Authors Kumar P.L.; Jayanthi M.; Singh J.; Gupta M.; Bobba P.B.; Albawi A.; Shubhra
Year 2025
Published 2025 International Conference on Intelligent Control, Computing and Communications, IC3 2025
DOI http://dx.doi.org/10.1109/IC363308.2025.10957274
Abstract The technical parameters of HEV energy management systems increase in interaction with connected and dynamic environments, therefore demanding superior control algorithms. This work proposes an asynchronous RL paradigm for energy management in driving HEV ecosystems. The framework uses distributed RL agents with each agent responsible for local policy optimization for energy control of individual electric vehicle and with sharing information through V2V and V2I mechanisms. A general optimization layer superposes local data to coordinate personal interests with global objectives, for example, the general level of emissions and traffic density. The proposed method is capable of effectively mitigating the periodic decision making issue through using high accuracy RL algorithms for instance the MAPPO alongside low latency communication. OpenPowertrainLib and SUMO are utilized for traffic modelling integrating stochastic traffic characteristics and renewable energy inputs as well as complicated vehicle dynamics. Research findings establish the efficiency in terms of energy savings and emissions compared to single optimized energy management solutions as well as improved traffic flow. The research puts emphasis on distributed RL frameworks in developing intelligent transportation systems that positively impact scalability and sustain ability of connected HEV networks. This study sets the ground for potential future developments in co-energy management and its incorporation into smart cities. © 2025 IEEE.
Author Keywords Collaborative Decision-Making Systems; Decentralized Reinforcement Learning; Hybrid Electric Vehicles; Multi-Agent Energy Optimization; Vehicle-to-Vehicle Communication


Similar Articles


Id Similarity Authors Title Published
44356 View0.869Faghri S.; Tahami H.; Amini R.; Katiraee H.; Godazi Langeroudi A.S.; Alinejad M.; Ghasempour Nejati M.Real-Time Energy Flexibility Optimization Of Grid-Connected Smart Building Communities With Deep Reinforcement LearningSustainable Cities and Society, 119 (2025)
36438 View0.868Vazquez-Canteli J.R.; Henze G.; Nagy Z.Marlisa: Multi-Agent Reinforcement Learning With Iterative Sequential Action Selection For Load Shaping Of Grid-Interactive Connected BuildingsBuildSys 2020 - Proceedings of the 7th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (2020)
51245 View0.864Raja G.; Saravanan G.; Prathiba S.B.; Akhtar Z.; Ali Khowaja S.; Dev K.Smart Navigation And Energy Management Framework For Autonomous Electric Vehicles In Complex EnvironmentsIEEE Internet of Things Journal, 10, 21 (2023)
28394 View0.863Ren Y.; Xie R.; Yu F.R.; Huang T.; Liu Y.Green Intelligence Networking For Connected And Autonomous Vehicles In Smart CitiesIEEE Transactions on Green Communications and Networking, 6, 3 (2022)
38114 View0.863Neelamegam G.; Venkatesan R.; Ramya S.R.; Ramya R.S.; Akshya J.; Sundarrajan M.; Choudhry M.D.Multi-Agent Systems For Autonomous Iot Network Management Using Distributed Reinforcement LearningProceedings of 2025 3rd International Conference on Intelligent Systems, Advanced Computing, and Communication, ISACC 2025 (2025)
11474 View0.862Özkan E.; Kök I.; Özdemir S.Autonomous Micro-Grids: A Reinforcement Learning-Based Energy Management Model In Smart Cities2023 International Symposium on Networks, Computers and Communications, ISNCC 2023 (2023)
4034 View0.859Wang E.; Memar F.H.; Korzelius S.; Sadek A.W.; Qiao C.A Reinforcement Learning Approach To Cav And Intersection Control For Energy EfficiencyProceedings - 2022 5th International Conference on Connected and Autonomous Driving, MetroCAD 2022 (2022)
32353 View0.858Dey S.; Xu H.Intelligent Distributed Charging Control For Large Scale Electric Vehicles: A Multi-Cluster Mean Field Game ApproachACM International Conference Proceeding Series (2023)
44879 View0.855Asad S.M.; Ozturk M.; Bin Rais R.N.; Zoha A.; Hussain S.; Abbasi Q.H.; Imran M.A.Reinforcement Learning Driven Energy Efficient Mobile Communication And Applications2019 IEEE 19th International Symposium on Signal Processing and Information Technology, ISSPIT 2019 (2019)
54026 View0.855Louati A.; Louati H.; Kariri E.; Neifar W.; Hassan M.K.; Khairi M.H.H.; Farahat M.A.; El-Hoseny H.M.Sustainable Smart Cities Through Multi-Agent Reinforcement Learning-Based Cooperative Autonomous VehiclesSustainability (Switzerland) , 16, 5 (2024)