Smart City Gnosys

Smart city article details

Title	Task Offloading In Autonomous Iot Systems Using Deep Reinforcement Learning And Ns3-Gym
ID_Doc	54435
Authors	Chabi Sika Boni A.K.; Hassan H.; Drira K.
Year	2021
Published	ACM International Conference Proceeding Series
DOI	http://dx.doi.org/10.1145/3494322.3494325
Abstract	IoT systems grow quickly and are massively present in urban areas. Their successful deployment requires autonomy that can be built on automated learning technologies such as Deep Learning. The IoT applications require important computational resources, rarely available on devices. Autonomous IoT systems require the computation power available on the edge and cloud servers in order to offload some tasks related to the supported applications and the underlying platforms. Task offloading constitutes a big challenge in autonomous IoT systems due to the huge number of IoT devices for scenarios of the family of smart cities. Managing task offloading in such contexts requires adaptive strategies capable of taking into consideration the rapid evolution of available resources and proposing efficient offloading solutions to all received requests. In this paper we use a Deep Reinforcement Learning (DRL) approach capable of handling large state spaces, and resolve the optimization problem in this context, where other techniques can not scale efficiently. Our solution is based on a DRL agent that was developed in the ns3-gym framework and was tested on IoT system scenario implemented in the NS3 simulator. The results obtained show that the DRL agent can adapt quickly to resource evolution in the IoT system and can handle big number of demands fulfilling scalabilty requirements of autonomous IoT systems. © 2021 ACM.
Author Keywords	Autonomous IoT systems; Deep Reinforcement Learning; Task offloading

Similar Articles

Id	Similarity	Authors	Title	Published
20621	0.958	Boni A.K.C.S.; Hablatou Y.; Hassan H.; Drira K.	Distributed Deep Reinforcement Learning Architecture For Task Offloading In Autonomous Iot Systems	ACM International Conference Proceeding Series (2022)
46071	0.911	Cui X.	Resource Allocation In Iot Edge Computing Networks Based On Reinforcement Learning	Advances in Transdisciplinary Engineering, 70 (2025)
7415	0.905	Moghaddasi K.; Rajabi S.; Gharehchopogh F.S.; Ghaffari A.	An Advanced Deep Reinforcement Learning Algorithm For Three-Layer D2D-Edge-Cloud Computing Architecture For Efficient Task Offloading In The Internet Of Things	Sustainable Computing: Informatics and Systems, 43 (2024)
26370	0.898	Han Y.; Li D.; Qi H.; Ren J.; Wang X.	Federated Learning-Based Computation Offloading Optimization In Edge Computing-Supported Internet Of Things	ACM International Conference Proceeding Series (2019)
23430	0.89	Sellami B.; Hakiri A.; Yahia S.B.; Berthou P.	Energy-Aware Task Scheduling And Offloading Using Deep Reinforcement Learning In Sdn-Enabled Iot Network	Computer Networks, 210 (2022)
38114	0.885	Neelamegam G.; Venkatesan R.; Ramya S.R.; Ramya R.S.; Akshya J.; Sundarrajan M.; Choudhry M.D.	Multi-Agent Systems For Autonomous Iot Network Management Using Distributed Reinforcement Learning	Proceedings of 2025 3rd International Conference on Intelligent Systems, Advanced Computing, and Communication, ISACC 2025 (2025)
1212	0.885	Liu P.; Peng K.; Zhao B.	A Cybertwin-Driven Intelligent Offloading Method For Iov Applications Using Drl In Smart Cities	Proceedings of the 2022 IEEE International Conference on Dependable, Autonomic and Secure Computing, International Conference on Pervasive Intelligence and Computing, International Conference on Cloud and Big Data Computing, International Conference on Cyber Science and Technology Congress, DASC/PiCom/CBDCom/CyberSciTech 2022 (2022)
54442	0.884	Zhao X.; Liu M.; Li M.	Task Offloading Strategy And Scheduling Optimization For Internet Of Vehicles Based On Deep Reinforcement Learning	Ad Hoc Networks, 147 (2023)
38090	0.881	Jiao T.; Feng X.; Guo C.; Wang D.; Song J.	Multi-Agent Deep Reinforcement Learning For Efficient Computation Offloading In Mobile Edge Computing	Computers, Materials and Continua, 76, 3 (2023)
18071	0.88	Bushehrian O.; Moazeni A.	Deep Reinforcement Learning-Based Optimal Deployment Of Iot Machine Learning Jobs In Fog Computing Architecture	Computing, 107, 1 (2025)