Smart City Gnosys

Smart city article details

Title	Energy-Aware Deep Reinforcement Learning Scheduling For Sensors Correlated In Time And Space
ID_Doc	23419
Authors	Hribar J.; Marinescu A.; Chiumento A.; Dasilva L.A.
Year	2022
Published	IEEE Internet of Things Journal, 9, 9
DOI	http://dx.doi.org/10.1109/JIOT.2021.3114102
Abstract	Millions of battery-powered sensors deployed for monitoring purposes in a multitude of scenarios, e.g., agriculture, smart cities, industry, etc., require energy-efficient solutions to prolong their lifetime. When these sensors observe a phenomenon distributed in space and evolving in time, it is expected that collected observations will be correlated in time and space. This article proposes a deep reinforcement learning (DRL)-based scheduling mechanism capable of taking advantage of correlated information. The designed solution employs deep deterministic policy gradient (DDPG) algorithm. The proposed mechanism can determine the frequency with which sensors should transmit their updates, to ensure accurate collection of observations, while simultaneously considering the energy available. The solution is evaluated with multiple data sets containing environmental observations obtained in multiple real deployments. The real observations are leveraged to model the environment with which the mechanism interacts as realistically as possible. The proposed solution can significantly extend the sensors' lifetime and is compared to an idealized, all-knowing scheduler to demonstrate that its performance is near optimal. Additionally, the results highlight the unique feature of the proposed design, energy-awareness, by displaying the impact of sensors' energy levels on the frequency of updates. © 2014 IEEE.
Author Keywords	Deep reinforcement learning (DRL); Internet of Things (IoT); Low-power sensors; Reinforcement learning

Similar Articles

Id	Similarity	Authors	Title	Published
23430	0.877	Sellami B.; Hakiri A.; Yahia S.B.; Berthou P.	Energy-Aware Task Scheduling And Offloading Using Deep Reinforcement Learning In Sdn-Enabled Iot Network	Computer Networks, 210 (2022)
16450	0.86	Zhou T.; Lin M.	Cpu Frequency Scheduling Of Real-Time Applications On Embedded Devices With Temporal Encoding-Based Deep Reinforcement Learning	Journal of Systems Architecture, 142 (2023)
46607	0.86	Salama R.; Alturjman S.; Altrjman C.; Al-Turjman F.	Reward-Based Energy-Aware Routing Protocols In Wireless Sensor Networks	Sustainable Civil Infrastructures (2024)
40637	0.859	Alatawi M.N.	Optimization Of Home Energy Management Systems In Smart Cities Using Bacterial Foraging Algorithm And Deep Reinforcement Learning For Enhanced Renewable Energy Integration	International Transactions on Electrical Energy Systems, 2024 (2024)
46071	0.856	Cui X.	Resource Allocation In Iot Edge Computing Networks Based On Reinforcement Learning	Advances in Transdisciplinary Engineering, 70 (2025)
18034	0.855	Sachithanandam V.; D. J.; V.S. B.; Manoharan M.	Deep Reinforcement Learning And Enhanced Optimization For Real-Time Energy Management In Wireless Sensor Networks	Sustainable Computing: Informatics and Systems, 45 (2025)
8796	0.855	Al-Hawawreh M.; Elgendi I.; Munasinghe K.	An Online Model To Minimize Energy Consumption Of Iot Sensors In Smart Cities	IEEE Sensors Journal, 22, 20 (2022)
31927	0.855	Liu F.; Li X.	Integrating Ai Deep Reinforcement Learning With Evolutionary Algorithms For Advanced Threat Detection In Smart City Energy Management	IEEE Access, 12 (2024)
35938	0.853	Li M.; Mour N.; Smith L.	Machine Learning Based On Reinforcement Learning For Smart Grids: Predictive Analytics In Renewable Energy Management	Sustainable Cities and Society, 109 (2024)
18048	0.851	Sheikhi M.; Hakami V.; Zarrabi H.	Deep Reinforcement Learning For Aoi-Aware Transmission Control In Energy-Harvesting Grant-Free Noma Iot Networks	11th International Symposium on Telecommunication: Communication in the Age of Artificial Intelligence, IST 2024 (2024)