Smart City Gnosys

Smart city article details

Title Deep Reinforcement Learning For Aoi-Aware Transmission Control In Energy-Harvesting Grant-Free Noma Iot Networks
ID_Doc 18048
Authors Sheikhi M.; Hakami V.; Zarrabi H.
Year 2024
Published 11th International Symposium on Telecommunication: Communication in the Age of Artificial Intelligence, IST 2024
DOI http://dx.doi.org/10.1109/IST64061.2024.10843446
Abstract The advent of Internet of Things (IoT) networks has revolutionized various real-time applications, such as healthcare, smart cities, and remote automation, by enabling seamless data exchange and real-time monitoring and control. Real-time applications require fresh data, which is quantified by a novel metric, Age of Information (AoI), defined as the time elapsed since the generation time of last successfully received data. Additionally, due to energy limitations in most IoT scenarios, the trade-off between age and energy becomes an important challenge in these networks. Motivated by the need to optimize both data freshness and energy efficiency, this paper considers a real-time scenario in energy-harvesting (EH) IoT networks that operate based on grant-free (GF) Non-Orthogonal Multiple Access (NOMA) mechanism. Given the foresighted nature of the transmission control problem due to the stochastic dynamics of the AoI and energy charging processes, we introduce a deep reinforcement learning (DRL) framework that dynamically manages transmission decisions and resource block allocation, minimizing the average sum AoI across IoT devices, while considering energy feasibility. Through extensive simulations, we demonstrate that our proposed DRL-based approach significantly outperforms existing methods in terms of expected cumulative cost, showcasing its potential for enhancing the performance of future IoT networks. © 2024 IEEE.
Author Keywords Age of Information; Energy Harvesting; Grant-Free Non-Orthogonal Multiple Access; Internet of Things


Similar Articles


Id Similarity Authors Title Published
46071 View0.875Cui X.Resource Allocation In Iot Edge Computing Networks Based On Reinforcement LearningAdvances in Transdisciplinary Engineering, 70 (2025)
23430 View0.875Sellami B.; Hakiri A.; Yahia S.B.; Berthou P.Energy-Aware Task Scheduling And Offloading Using Deep Reinforcement Learning In Sdn-Enabled Iot NetworkComputer Networks, 210 (2022)
7035 View0.868Hamedoon S.M.; Nasar Chattha J.; Rashid U.; Ahsan Kazmi S.M.; Mazzara M.Ai-Driven Resource Allocation For Ris-Assisted Noma In Iot NetworksIEEE Access, 13 (2025)
23355 View0.867Poongodi T.; Sharma R.K.Energy Optimized Route Selection In Wsns For Smart Iot Applications2nd IEEE International Conference on Distributed Computing and Electrical Circuits and Electronics, ICDCECE 2023 (2023)
8796 View0.864Al-Hawawreh M.; Elgendi I.; Munasinghe K.An Online Model To Minimize Energy Consumption Of Iot Sensors In Smart CitiesIEEE Sensors Journal, 22, 20 (2022)
34433 View0.855Yao R.; Liu L.; Zuo X.; Yu L.; Xu J.; Fan Y.; Li W.Joint Task Offloading And Power Control Optimization For Iot-Enabled Smart Cities: An Energy-Efficient Coordination Via Deep Reinforcement LearningIEEE Transactions on Consumer Electronics (2025)
20621 View0.854Boni A.K.C.S.; Hablatou Y.; Hassan H.; Drira K.Distributed Deep Reinforcement Learning Architecture For Task Offloading In Autonomous Iot SystemsACM International Conference Proceeding Series (2022)
28406 View0.852Preethi; Ulla M.M.; Sapna R.; Devadas R.; Priya; Ambika B.J.Green Iot: Ai-Powered Solutions For Sustainable Energy Management In Smart DevicesProcedia Computer Science, 258 (2025)
23419 View0.851Hribar J.; Marinescu A.; Chiumento A.; Dasilva L.A.Energy-Aware Deep Reinforcement Learning Scheduling For Sensors Correlated In Time And SpaceIEEE Internet of Things Journal, 9, 9 (2022)