Smart City Gnosys
Smart city article details
| Title | Deep Reinforcement Learning-Based Optimal Deployment Of Iot Machine Learning Jobs In Fog Computing Architecture |
|---|---|
| ID_Doc | 18071 |
| Authors | Bushehrian O.; Moazeni A. |
| Year | 2025 |
| Published | Computing, 107, 1 |
| DOI | http://dx.doi.org/10.1007/s00607-024-01353-3 |
| Abstract | By increasing the number and variety of areas where IoT technology is being applied, the challenges regarding the design and deployment of IoT applications and services have recently become the subject of many studies. Many IoT applications are machine learning jobs that collect and analyze sensor measurements in smart cities, farms, or industrial areas to meet the end-user requirements. These machine-learning jobs consist of distributed tasks that work collaboratively to build models in a federated manner. Though some challenges regarding the deployment and scheduling of IoT applications have been studied before, the problem of determining the optimal number and the coverage of distributed tasks of an IoT machine learning job has not been addressed previously. This paper proposes a two-phased method for adaptive task creation and deployment of IoT machine learning jobs over a heterogeneous multi-layer fog computing architecture. In the first phase, the optimal number of tasks and their respective sensor coverage is determined using a Deep Reinforcement Learning (DRL) based method and subsequently, in the second phase, the tasks are deployed over the heterogeneous multi-layer fog computing architecture using a greedy deployment method. The task creation and deployment problem is formulated as a three-objective optimization problem: 1) minimizing the deployment latency 2) minimizing the deployment cost and, 3) minimizing the evaluation loss of the machine learning job when trained in a federated manner over the edge/fog/cloud nodes. A Deep Deterministic Policy Gradient (DDPG) algorithm is used to solve the online IoT machine learning job deployment optimization problem adaptively and efficiently. The experimental results obtained by the deployment of several IoT machine learning jobs with disparate profiles over the heterogeneous fog test-bed showed that the proposed two-phased DRL-based method could outperform the Edge-IoT and Cloud-IoT baseline methods by improving the total deployment score up to 32%. © The Author(s), under exclusive licence to Springer-Verlag GmbH Austria, part of Springer Nature 2024. |
| Author Keywords | Deep reinforcement learning; Federated learning; Fog computing; IoT application deployment |
Similar Articles
| Id | Similarity | Authors | Title | Published |
|---|---|---|---|---|
46071  | 0.908 | Cui X. | Resource Allocation In Iot Edge Computing Networks Based On Reinforcement Learning | Advances in Transdisciplinary Engineering, 70 (2025) |
| 23430 | 0.904 | Sellami B.; Hakiri A.; Yahia S.B.; Berthou P. | Energy-Aware Task Scheduling And Offloading Using Deep Reinforcement Learning In Sdn-Enabled Iot Network | Computer Networks, 210 (2022) |
| 37003 | 0.893 | Boudieb W.; Malki A.; Malki M.; Badawy A.; Barhamgi M. | Microservice Instances Selection And Load Balancing In Fog Computing Using Deep Reinforcement Learning Approach | Future Generation Computer Systems, 156 (2024) |
| 26323 | 0.89 | Chen X.; Liu G. | Federated Deep Reinforcement Learning-Based Task Offloading And Resource Allocation For Smart Cities In A Mobile Edge Network | Sensors, 22, 13 (2022) |
| 7415 | 0.889 | Moghaddasi K.; Rajabi S.; Gharehchopogh F.S.; Ghaffari A. | An Advanced Deep Reinforcement Learning Algorithm For Three-Layer D2D-Edge-Cloud Computing Architecture For Efficient Task Offloading In The Internet Of Things | Sustainable Computing: Informatics and Systems, 43 (2024) |
| 60278 | 0.888 | Bansal M.; Chana I.; Clarke S. | Urbanenqosplace: A Deep Reinforcement Learning Model For Service Placement Of Real-Time Smart City Iot Applications | IEEE Transactions on Services Computing, 16, 4 (2023) |
| 9491 | 0.885 | Ashouri M.; Lorig F.; Davidsson P.; Spalazzese R.; Svorobej S. | Analyzing Distributed Deep Neural Network Deployment On Edge And Cloud Nodes In Iot Systems | Proceedings - 2020 IEEE 13th International Conference on Edge Computing, EDGE 2020 (2020) |
| 14476 | 0.884 | Lilhore U.K.; Simaiya S.; Sharma Y.K.; Rai A.K.; Padmaja S.M.; Nabilal K.V.; Kumar V.; Alroobaea R.; Alsufyani H. | Cloud-Edge Hybrid Deep Learning Framework For Scalable Iot Resource Optimization | Journal of Cloud Computing, 14, 1 (2025) |
| 54435 | 0.88 | Chabi Sika Boni A.K.; Hassan H.; Drira K. | Task Offloading In Autonomous Iot Systems Using Deep Reinforcement Learning And Ns3-Gym | ACM International Conference Proceeding Series (2021) |
| 26075 | 0.879 | Nagabushnam G.; Kim K.H. | Faddeer: A Deep Multi-Agent Reinforcement Learning-Based Scheduling Algorithm For Aperiodic Tasks In Heterogeneous Fog Computing Networks | Cluster Computing, 28, 6 (2025) |