Smart City Gnosys

Smart city article details

Title	An Applied Deep Reinforcement Learning Approach To Control Active Networked Microgrids In Smart Cities With Multi-Level Participation Of Battery Energy Storage System And Electric Vehicles
ID_Doc	7568
Authors	Sepehrzad R.; Langeroudi A.S.G.; Khodadadi A.; Adinehpour S.; Al-Durra A.; Anvari-Moghaddam A.
Year	2024
Published	Sustainable Cities and Society, 107
DOI	http://dx.doi.org/10.1016/j.scs.2024.105352
Abstract	This study proposed an intelligent energy management strategy for islanded networked microgrids (NMGs) in smart cities considering the renewable energy sources uncertainties and power fluctuations. Energy management of active power and frequency control approach is based on the intelligent probabilistic wavelet fuzzy neural network-deep reinforcement learning algorithm (IPWFNN-DRLA). The control strategy is formulated with deep reinforcement learning approach based on the Markov decision process and solved by the soft actor-critic algorithm. The NMG local controller (NMGLC) provides information such as the frequency, active power, power generation data, and status of the electric vehicle's battery energy storage system to the NMG central controller (NMGCC). Then the NMGCC calculates active power and frequency support based on the IPWFNN-DRLA approach and sends the results to the NMGLC. The proposed model is developed in a continuous problem-solving space with two structures of offline training and decentralized distributed operation. For this purpose, each NMG has a control agent (NMGCA) based on the IPWFNN algorithm, and the NMGCA learning model is formulated based the online back-propagation learning algorithm. The proposed approach demonstrates a computation accuracy exceeding 98%, along with a 7.82% reduction in computational burden and a 61.1% reduction in computation time compared to alternative methods. © 2024 The Author(s)
Author Keywords	Deep reinforcement learning algorithm; Electric vehicles; Energy management; Networked microgrid

Similar Articles

Id	Similarity	Authors	Title	Published
59206	0.895	Sepehrzad R.; Hedayatnia A.; Amohadi M.; Ghafourian J.; Al-Durra A.; Anvari-Moghaddam A.	Two-Stage Experimental Intelligent Dynamic Energy Management Of Microgrid In Smart Cities Based On Demand Response Programs And Energy Storage System Participation	International Journal of Electrical Power and Energy Systems, 155 (2024)
18065	0.886	Shi L.; Lu S.; Feng T.	Deep Reinforcement Learning-Based Data-Driven Active Power Dispatching For Smart City Grid	2023 IEEE International Conference on Power Science and Technology, ICPST 2023 (2023)
38545	0.885	Reza S.; Atefeh H.; Javid G.; Ahmed A.D.	Multilevel Energy Management And Optimal Control System In Smart Cities Based On Deep Machine Learning	Applications of Deep Machine Learning in Future Energy Systems (2024)
44356	0.879	Faghri S.; Tahami H.; Amini R.; Katiraee H.; Godazi Langeroudi A.S.; Alinejad M.; Ghasempour Nejati M.	Real-Time Energy Flexibility Optimization Of Grid-Connected Smart Building Communities With Deep Reinforcement Learning	Sustainable Cities and Society, 119 (2025)
8508	0.875	Senthilkumar T.; Sivaraju S.S.; Anuradha T.; Vimalarani C.	An Intelligent Electric Vehicle Charging System In A Smart Grid Using Artificial Intelligence	Optimal Control Applications and Methods, 46, 3 (2025)
17430	0.862	Khodadadi A.; Adinehpour S.; Sepehrzad R.; Al-Durra A.; Anvari-Moghaddam A.	Data-Driven Hierarchical Energy Management In Multi-Integrated Energy Systems Considering Integrated Demand Response Programs And Energy Storage System Participation Based On Madrl Approach	Sustainable Cities and Society, 103 (2024)
11474	0.862	Özkan E.; Kök I.; Özdemir S.	Autonomous Micro-Grids: A Reinforcement Learning-Based Energy Management Model In Smart Cities	2023 International Symposium on Networks, Computers and Communications, ISNCC 2023 (2023)
31862	0.86	Zhao X.; Zhang Y.	Integrated Management Of Urban Resources Toward Net-Zero Smart Cities Considering Renewable Energies Uncertainty And Modeling In Digital Twin	Sustainable Energy Technologies and Assessments, 64 (2024)
11464	0.858	Suanpang P.; Jamjuntr P.; Jermsittiparsert K.; Kaewyong P.	Autonomous Energy Management By Applying Deep Q-Learning To Enhance Sustainability In Smart Tourism Cities	Energies, 15, 5 (2022)
32373	0.855	Mithul Raaj A.T.; Balaji B.; R R S.A.P.; Naidu R.C.; Rajesh Kumar M.; Ramachandran P.; Rajkumar S.; Kumar V.N.; Aggarwal G.; Siddiqui A.M.	Intelligent Energy Management Across Smart Grids Deploying 6G Iot, Ai, And Blockchain In Sustainable Smart Cities	IoT, 5, 3 (2024)