Smart City Gnosys

Smart city article details

Title	Optimizing Smart City Water Distribution Systems Using Deep Reinforcement Learning
ID_Doc	40889
Authors	Zaman M.; Tantawy A.; Abdelwahed S.
Year	2023
Published	2023 IEEE 20th International Conference on Smart Communities: Improving Quality of Life using AI, Robotics and IoT, HONET 2023
DOI	http://dx.doi.org/10.1109/HONET59747.2023.10374894
Abstract	Inefficient scheduling in water distribution systems can lead to energy waste, costly overflows, and a system that cannot keep up with demand. Simultaneous real-time management of system components such as pumps and valves to optimize operation in response to demand variations is a challenging task. Recent advances in deep reinforcement learning provides an opportunity to overcome the state explosion problem using function approximation to generalize from a limited interaction with the environment. In this work, we train a Long Short-Term Memory (LSTM) based Reinforcement Learning (RL) agent to optimize the energy usage of a smart water distribution system while maintaining a safe operating envelope. We compare the performance of the RL agent to two agents based on human experience in the domain; a baseline controller that is based on simple operational logic, and a fuzzy logic controller that captures imprecise human requirements. We show that the RL agent outperforms the other agents in terms of energy usage and operational safety, indicating its potential benefits for large-scale smart city systems. Future research work will focus on prioritized large-scale system scheduling to cope with smart city emergency situations. © 2023 IEEE.
Author Keywords	Fuzzy logic control; Optimization; Reinforcement learning; Scheduling; Smart city; Water distribution

Similar Articles

Id	Similarity	Authors	Title	Published
38102	0.871	Vazquez-Canteli J.; Detjeen T.; Henze G.; Kämpf J.; Nagy Z.	Multi-Agent Reinforcement Learning For Adaptive Demand Response In Smart Cities	Journal of Physics: Conference Series, 1343, 1 (2019)
7714	0.865	Ludolfinger U.; Martens M.	An Autonomous Energy Management Concept For Sustainable Smart Cities	2023 IEEE European Technology and Engineering Management Summit, E-TEMS 2023 - Conference Proceedings (2023)
38699	0.863	Wang Q.; Wang P.; Cai M.	Multivariate Time Series Forecasting Of Daily Urban Water Demand Using Reinforcement Learning And Gated Recurrent Unit Network	ACM International Conference Proceeding Series (2024)
31927	0.862	Liu F.; Li X.	Integrating Ai Deep Reinforcement Learning With Evolutionary Algorithms For Advanced Threat Detection In Smart City Energy Management	IEEE Access, 12 (2024)
36438	0.862	Vazquez-Canteli J.R.; Henze G.; Nagy Z.	Marlisa: Multi-Agent Reinforcement Learning With Iterative Sequential Action Selection For Load Shaping Of Grid-Interactive Connected Buildings	BuildSys 2020 - Proceedings of the 7th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (2020)
40882	0.862	Park J.; Baek J.; Song Y.	Optimizing Smart City Planning: A Deep Reinforcement Learning Framework	ICT Express, 11, 1 (2025)
11474	0.86	Özkan E.; Kök I.; Özdemir S.	Autonomous Micro-Grids: A Reinforcement Learning-Based Energy Management Model In Smart Cities	2023 International Symposium on Networks, Computers and Communications, ISNCC 2023 (2023)
35418	0.857	Alorbani A.; Bauer M.	Load Balancing And Resource Allocation In Smart Cities Using Reinforcement Learning	2021 IEEE International Smart Cities Conference, ISC2 2021 (2021)
18050	0.856	Kavitha T.; Chaganti K.R.; Elicherla S.L.R.; Kumar M.R.; Chaithanya D.; Manikanta K.	Deep Reinforcement Learning For Energy Efficiency Optimization Using Autonomous Waste Management In Smart Cities	Proceedings of 5th International Conference on Trends in Material Science and Inventive Materials, ICTMIM 2025 (2025)
35938	0.854	Li M.; Mour N.; Smith L.	Machine Learning Based On Reinforcement Learning For Smart Grids: Predictive Analytics In Renewable Energy Management	Sustainable Cities and Society, 109 (2024)