Smart City Gnosys

Smart city article details

Title	Autonomous Micro-Grids: A Reinforcement Learning-Based Energy Management Model In Smart Cities
ID_Doc	11474
Authors	Özkan E.; Kök I.; Özdemir S.
Year	2023
Published	2023 International Symposium on Networks, Computers and Communications, ISNCC 2023
DOI	http://dx.doi.org/10.1109/ISNCC58260.2023.10323891
Abstract	The growing electricity consumption of communities has raised concerns about the environmental impact of traditional energy sources. To mitigate these concerns, governments are promoting to utilize renewable energy sources. However, the intermittent nature of renewable energy poses significant challenges for gird stability. Micro-grids have emerged as promising solutions to address these challenges. A micro-grid is an independent electric system that can generate, distribute, and manage electricity within a small area. It offers many advantages such as; peak load reduction, minimized load variability, and enhanced power quality. Energy management systems (EMS) within micro-grids play a significant role in overcoming operational challenges. They are designed to control micro-grid systems with the goal of flattening, smoothing, and reducing the curve of electrical demand. This helps to reduce the operational costs of electricity generation, transmission and distribution. Reinforcement Learning (RL) has been an important research area for EMS systems. By leveraging historical and real-time data, RL enables effective control of EMS systems within micro-grids. However, despite the advancements in this area, many of these research is challenging to reproduce. In this work, we use SAC and PPO RL agents in a micro-grid architecture. We make use of Citylearn framework to test our agents. We compare our agents with the Rule Based Controller (RBC). Our test results show that our solution is able to improve the micro-grid performance by effectively smoothing the electricity consumption. © 2023 IEEE.
Author Keywords	Artificial intelligence; Deep reinforcement learning (DRL); Energy management system (EMS); Micro-grid

Similar Articles

Id	Similarity	Authors	Title	Published
36438	0.904	Vazquez-Canteli J.R.; Henze G.; Nagy Z.	Marlisa: Multi-Agent Reinforcement Learning With Iterative Sequential Action Selection For Load Shaping Of Grid-Interactive Connected Buildings	BuildSys 2020 - Proceedings of the 7th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (2020)
26378	0.889	Khanna A.; Maheshwari P.	Federated Multi-Agent Reinforcement Learning For Incentive-Based Drs Over Blockchain Enabled Microgrids	2024 7th International Conference on Signal Processing and Information Security, ICSPIS 2024 (2024)
7714	0.886	Ludolfinger U.; Martens M.	An Autonomous Energy Management Concept For Sustainable Smart Cities	2023 IEEE European Technology and Engineering Management Summit, E-TEMS 2023 - Conference Proceedings (2023)
8522	0.877	Jiao Y.; Kang H.; Sun H.	An Intelligent Landscaping Framework For Net-Zero Energy Smart Cities: A Green Infrastructure Approach	Sustainable Energy Technologies and Assessments, 64 (2024)
9147	0.877	Mohammadi P.; Darshi R.; Shamaghdari S.	Analysis Of Dissatisfaction Factor On Customer'S Bills In Smart Microgrids Using Reinforcement Learning	Proceeding of 8th International Conference on Smart Cities, Internet of Things and Applications, SCIoT 2024 (2024)
11464	0.874	Suanpang P.; Jamjuntr P.; Jermsittiparsert K.; Kaewyong P.	Autonomous Energy Management By Applying Deep Q-Learning To Enhance Sustainability In Smart Tourism Cities	Energies, 15, 5 (2022)
32373	0.872	Mithul Raaj A.T.; Balaji B.; R R S.A.P.; Naidu R.C.; Rajesh Kumar M.; Ramachandran P.; Rajkumar S.; Kumar V.N.; Aggarwal G.; Siddiqui A.M.	Intelligent Energy Management Across Smart Grids Deploying 6G Iot, Ai, And Blockchain In Sustainable Smart Cities	IoT, 5, 3 (2024)
35938	0.868	Li M.; Mour N.; Smith L.	Machine Learning Based On Reinforcement Learning For Smart Grids: Predictive Analytics In Renewable Energy Management	Sustainable Cities and Society, 109 (2024)
54163	0.865	Tungom C.E.; Wang H.; Beata K.; Niu B.	Swoam: Swarm Optimized Agents For Energy Management In Grid-Interactive Connected Buildings	Energy, 301 (2024)
44356	0.863	Faghri S.; Tahami H.; Amini R.; Katiraee H.; Godazi Langeroudi A.S.; Alinejad M.; Ghasempour Nejati M.	Real-Time Energy Flexibility Optimization Of Grid-Connected Smart Building Communities With Deep Reinforcement Learning	Sustainable Cities and Society, 119 (2025)