Smart City Gnosys

Smart city article details

Title Swoam: Swarm Optimized Agents For Energy Management In Grid-Interactive Connected Buildings
ID_Doc 54163
Authors Tungom C.E.; Wang H.; Beata K.; Niu B.
Year 2024
Published Energy, 301
DOI http://dx.doi.org/10.1016/j.energy.2024.131399
Abstract With increasing complexity of smart city energy systems and rising energy demand, effective energy management solutions are crucial. Buildings now incorporate renewable energy sources and battery storage for efficient energy utilization, making optimal control strategies important. Compared to rule-based controllers and model-based methods, swarm and evolutionary algorithms have the advantages of providing cost-effective, stable, and scalable alternatives. However, their potential in data-rich environments and multi-building energy systems remains underexplored. This research bridges this gap by demonstrating the cooperative capabilities of population-based optimization agents for efficient energy management. Specifically, novel algorithm and framework, named Swarm Optimized Agents for Sequential Decision Making (SWOAM) is proposed. It combines an online k-means classifier and a swarm optimizer for optimal control of multi-building energy systems. By designing an online K-means learning strategy and an agent-based sequential episodic sampling approach, it is feasible to train a swarm of agents find an optimal energy management policy for buildings in a district. For training and evaluation, we use the standardized CityLearn building energy management environment. The agents are evaluated on three key metrics: electricity cost, carbon dioxide emissions and grid ramping. SWOAM delivers state-of-the-art performance and outperforms modern reinforcement learning and rule-based controllers. © 2024
Author Keywords Energy management; Online learning; Sequential decision making; Swarm intelligence; Unsupervised classification


Similar Articles


Id Similarity Authors Title Published
54129 View0.918Tungom C.E.; Niu B.; Wang H.Swapp: Swarm Precision Policy Optimization With Dynamic Action Bound Adjustment For Energy Management In Smart CitiesApplied Energy, 377 (2025)
36438 View0.894Vazquez-Canteli J.R.; Henze G.; Nagy Z.Marlisa: Multi-Agent Reinforcement Learning With Iterative Sequential Action Selection For Load Shaping Of Grid-Interactive Connected BuildingsBuildSys 2020 - Proceedings of the 7th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (2020)
7714 View0.877Ludolfinger U.; Martens M.An Autonomous Energy Management Concept For Sustainable Smart Cities2023 IEEE European Technology and Engineering Management Summit, E-TEMS 2023 - Conference Proceedings (2023)
38102 View0.874Vazquez-Canteli J.; Detjeen T.; Henze G.; Kämpf J.; Nagy Z.Multi-Agent Reinforcement Learning For Adaptive Demand Response In Smart CitiesJournal of Physics: Conference Series, 1343, 1 (2019)
50838 View0.874Mongaillard T.; Lasaulce S.; Varma V.S.Smart Energy Management: From Conventional Optimization To Generative Ai TechniquesLecture Notes in Intelligent Transportation and Infrastructure, Part F99 (2025)
38091 View0.872Tariq S.; Ali U.; Kim S.; Yoo C.Multi-Agent Distributed Reinforcement Learning For Energy-Efficient Thermal Comfort Control In Multi-Zone Buildings With Diverse Occupancy PatternsEnergy, 332 (2025)
13413 View0.87Chen L.; Li X.; Zhu J.Carbon Peak Control For Achieving Net-Zero Renewable-Based Smart Cities: Digital Twin Modeling And SimulationSustainable Energy Technologies and Assessments, 65 (2024)
11474 View0.865Özkan E.; Kök I.; Özdemir S.Autonomous Micro-Grids: A Reinforcement Learning-Based Energy Management Model In Smart Cities2023 International Symposium on Networks, Computers and Communications, ISNCC 2023 (2023)
31927 View0.861Liu F.; Li X.Integrating Ai Deep Reinforcement Learning With Evolutionary Algorithms For Advanced Threat Detection In Smart City Energy ManagementIEEE Access, 12 (2024)
54040 View0.861Lee D.-K.; Yoon S.-H.; Kwak J.-H.; Cho C.-H.; Lee D.-H.Sustainable Smart City Building-Energy Management Based On Reinforcement Learning And Sales Of Ess PowerKSII Transactions on Internet and Information Systems, 17, 4 (2023)