Smart City Gnosys
Smart city article details
| Title | Autonomous Energy Management By Applying Deep Q-Learning To Enhance Sustainability In Smart Tourism Cities |
|---|---|
| ID_Doc | 11464 |
| Authors | Suanpang P.; Jamjuntr P.; Jermsittiparsert K.; Kaewyong P. |
| Year | 2022 |
| Published | Energies, 15, 5 |
| DOI | http://dx.doi.org/10.3390/en15051906 |
| Abstract | Autonomous energy management is becoming a significant mechanism for attaining sustainability in energy management. This resulted in this research paper, which aimed to apply deep reinforcement learning algorithms for an autonomous energy management system of a microgrid. This paper proposed a novel microgrid model that consisted of a combustion set of a household load, renewable energy, an energy storage system, and a generator, which were connected to the main grid. The proposed autonomous energy management system was designed to cooperate with the various flexible sources and loads by defining the priority resources, loads, and electricity prices. The system was implemented by using deep reinforcement learning algorithms that worked effectively in order to control the power storage, solar panels, generator, and main grid. The system model could achieve the optimal performance with near-optimal policies. As a result, this method could save 13.19% in the cost compared to conducting manual control of energy management. In this study, there was a focus on applying Q-learning for the microgrid in the tourism industry in remote areas which can produce and store energy. Therefore, we proposed an autonomous energy management system for effective energy management. In future work, the system could be improved by applying deep learning to use energy price data to predict the future energy price, when the system could produce more energy than the demand and store it for selling at the most appropriate price; this would make the autonomous energy management system smarter and provide better benefits for the tourism industry. This proposed autonomous energy management could be applied to other industries, for example businesses or factories which need effective energy management to maintain microgrid stability and also save energy. © 2022 by the authors. Licensee MDPI, Basel, Switzerland. |
| Author Keywords | Autonomous energy; Deep Q-learning; Energy management; Smart city; Smart tourism; Sustainability |
Similar Articles
| Id | Similarity | Authors | Title | Published |
|---|---|---|---|---|
17952  | 0.888 | Mahmoud M.; Ben Slama S. | Deep Learning-Based Home Energy Management Incorporating Vehicle-To-Home And Home-To-Vehicle Technologies For Renewable Integration | Energies, 18, 1 (2025) |
| 32373 | 0.885 | Mithul Raaj A.T.; Balaji B.; R R S.A.P.; Naidu R.C.; Rajesh Kumar M.; Ramachandran P.; Rajkumar S.; Kumar V.N.; Aggarwal G.; Siddiqui A.M. | Intelligent Energy Management Across Smart Grids Deploying 6G Iot, Ai, And Blockchain In Sustainable Smart Cities | IoT, 5, 3 (2024) |
| 7714 | 0.883 | Ludolfinger U.; Martens M. | An Autonomous Energy Management Concept For Sustainable Smart Cities | 2023 IEEE European Technology and Engineering Management Summit, E-TEMS 2023 - Conference Proceedings (2023) |
| 9147 | 0.882 | Mohammadi P.; Darshi R.; Shamaghdari S. | Analysis Of Dissatisfaction Factor On Customer'S Bills In Smart Microgrids Using Reinforcement Learning | Proceeding of 8th International Conference on Smart Cities, Internet of Things and Applications, SCIoT 2024 (2024) |
| 11474 | 0.874 | Özkan E.; Kök I.; Özdemir S. | Autonomous Micro-Grids: A Reinforcement Learning-Based Energy Management Model In Smart Cities | 2023 International Symposium on Networks, Computers and Communications, ISNCC 2023 (2023) |
| 17962 | 0.872 | Aljohani A. | Deep Learning-Based Optimization Of Energy Utilization In Iot-Enabled Smart Cities: A Pathway To Sustainable Development | Energy Reports, 12 (2024) |
| 50953 | 0.867 | Tripathy N.; Tripathy S.S. | Smart Green Cities Using Iot-Based Deep Reinforcement Learning Energy Management | Internet of Things and Big Data Analytics for a Green Environment (2024) |
| 28406 | 0.865 | Preethi; Ulla M.M.; Sapna R.; Devadas R.; Priya; Ambika B.J. | Green Iot: Ai-Powered Solutions For Sustainable Energy Management In Smart Devices | Procedia Computer Science, 258 (2025) |
| 35938 | 0.865 | Li M.; Mour N.; Smith L. | Machine Learning Based On Reinforcement Learning For Smart Grids: Predictive Analytics In Renewable Energy Management | Sustainable Cities and Society, 109 (2024) |
| 31927 | 0.864 | Liu F.; Li X. | Integrating Ai Deep Reinforcement Learning With Evolutionary Algorithms For Advanced Threat Detection In Smart City Energy Management | IEEE Access, 12 (2024) |