Smart City Gnosys

Smart city article details

Title	Federated Multi-Agent Reinforcement Learning For Incentive-Based Drs Over Blockchain Enabled Microgrids
ID_Doc	26378
Authors	Khanna A.; Maheshwari P.
Year	2024
Published	2024 7th International Conference on Signal Processing and Information Security, ICSPIS 2024
DOI	http://dx.doi.org/10.1109/ICSPIS63676.2024.10812651
Abstract	The paper investigates the integration of multiagent reinforcement learning (MARL) and federated learning for smart energy management systems focusing on Sustainable Development Goals (SDG) 7 and 11 which are Affordable and Clean Energy, and Sustainable Cities and Communities. We present a demand response system (DRS) within microgrids that is incentive-based with solar energy as the main renewable resource. Our model incorporates the use of federated learning to improve data privacy and efficiency, while multi-agent reinforcement learning optimizes the process of energy trading, load balancing, and grid stability. Three algorithms-Deep Deterministic Policy Gradient (DDPG), Multi-Agent Deep Deterministic Policy Gradient (MADDPG), and Asynchronous Advantage Actor-Critic (A3C)-are compared in terms of their performance for this purpose. The study also investigates how direct load control (DLC) programs along with demand bidding can be utilized as incentives that encourage participation in DRS. The experimental results show that merging MARL with federated learning in microgrids leads to improved energy efficiency, cost reduction, as well as sustainable energy consumption behaviours. These outcomes support broader targets to establish strong, durable energy systems in smart cities under the United Nations' SDGs. © 2024 IEEE.
Author Keywords	Blockchain; Federated Learning; Microgrids; Reinforcement learning; SDGs

Similar Articles

Id	Similarity	Authors	Title	Published
35938	0.9	Li M.; Mour N.; Smith L.	Machine Learning Based On Reinforcement Learning For Smart Grids: Predictive Analytics In Renewable Energy Management	Sustainable Cities and Society, 109 (2024)
11474	0.889	Özkan E.; Kök I.; Özdemir S.	Autonomous Micro-Grids: A Reinforcement Learning-Based Energy Management Model In Smart Cities	2023 International Symposium on Networks, Computers and Communications, ISNCC 2023 (2023)
38102	0.882	Vazquez-Canteli J.; Detjeen T.; Henze G.; Kämpf J.; Nagy Z.	Multi-Agent Reinforcement Learning For Adaptive Demand Response In Smart Cities	Journal of Physics: Conference Series, 1343, 1 (2019)
36438	0.876	Vazquez-Canteli J.R.; Henze G.; Nagy Z.	Marlisa: Multi-Agent Reinforcement Learning With Iterative Sequential Action Selection For Load Shaping Of Grid-Interactive Connected Buildings	BuildSys 2020 - Proceedings of the 7th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (2020)
7714	0.871	Ludolfinger U.; Martens M.	An Autonomous Energy Management Concept For Sustainable Smart Cities	2023 IEEE European Technology and Engineering Management Summit, E-TEMS 2023 - Conference Proceedings (2023)
32373	0.869	Mithul Raaj A.T.; Balaji B.; R R S.A.P.; Naidu R.C.; Rajesh Kumar M.; Ramachandran P.; Rajkumar S.; Kumar V.N.; Aggarwal G.; Siddiqui A.M.	Intelligent Energy Management Across Smart Grids Deploying 6G Iot, Ai, And Blockchain In Sustainable Smart Cities	IoT, 5, 3 (2024)
31927	0.866	Liu F.; Li X.	Integrating Ai Deep Reinforcement Learning With Evolutionary Algorithms For Advanced Threat Detection In Smart City Energy Management	IEEE Access, 12 (2024)
9147	0.863	Mohammadi P.; Darshi R.; Shamaghdari S.	Analysis Of Dissatisfaction Factor On Customer'S Bills In Smart Microgrids Using Reinforcement Learning	Proceeding of 8th International Conference on Smart Cities, Internet of Things and Applications, SCIoT 2024 (2024)
44356	0.858	Faghri S.; Tahami H.; Amini R.; Katiraee H.; Godazi Langeroudi A.S.; Alinejad M.; Ghasempour Nejati M.	Real-Time Energy Flexibility Optimization Of Grid-Connected Smart Building Communities With Deep Reinforcement Learning	Sustainable Cities and Society, 119 (2025)
26370	0.852	Han Y.; Li D.; Qi H.; Ren J.; Wang X.	Federated Learning-Based Computation Offloading Optimization In Edge Computing-Supported Internet Of Things	ACM International Conference Proceeding Series (2019)