Smart City Gnosys

Smart city article details

Title Faddeer: A Deep Multi-Agent Reinforcement Learning-Based Scheduling Algorithm For Aperiodic Tasks In Heterogeneous Fog Computing Networks
ID_Doc 26075
Authors Nagabushnam G.; Kim K.H.
Year 2025
Published Cluster Computing, 28, 6
DOI http://dx.doi.org/10.1007/s10586-025-05435-5
Abstract Fog computing has become essential for real-time applications in domains such as autonomous driving, smart cities, Industry 4.0, and large-scale IoT ecosystems, where low latency and efficient resource utilization are critical. However, scheduling aperiodic tasks in fog environments remains a significant challenge, particularly when ensuring strict deadline adherence, energy efficiency, and optimized use of heterogeneous low-power devices. This challenge is further intensified by the dynamic and unpredictable nature of fog networks, making the problem NP-hard. To address these issues, we propose FADDEER (fog adaptive deadline-driven energy efficient reinforcement), a novel deep multi-agent reinforcement learning (Deep MARL)-based scheduling algorithm that integrates earliest deadline first (EDF) and asynchronous advantage actor-critic (A3C) to enable adaptive, scalable, and deadline-aware task scheduling. FADDEER intelligently allocates aperiodic tasks to distributed fog nodes, dynamically balancing task makespan, energy consumption, and resource utilization. Experiments were conducted using the COSCO simulation framework with workloads ranging from 100 to 1,000 aperiodic tasks distributed across fog networks of 10 to 100 nodes, respectively. The results demonstrate that FADDEER consistently outperforms state-of-the-art algorithms, including A3C, multi-agent deep deterministic policy gradient (MADDPG), genetic algorithm, particle swarm optimization (PSO), EDF achieving up to 4% higher deadline adherence and up to 55% lower energy consumption compared to the next best alternatives. Moreover, FADDEER achieved up to 19.4% lower makespan under high task loads and significantly reduced scheduling time, validating its efficiency and responsiveness in dynamic fog environments. These outcomes highlight FADDEER’s robustness, scalability, and effectiveness for real-time IoT task scheduling in fog computing frameworks. © The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2025.
Author Keywords Aperiodic; Asynchronous advantage actor-critic; Cloud; Deadline task; Deep multi-agent reinforcement learning; Heterogeneous fog; IoT; Task scheduling


Similar Articles


Id Similarity Authors Title Published
39777 View0.91Mattia G.P.; Beraldi R.On Real-Time Scheduling In Fog Computing: A Reinforcement Learning Algorithm With Application To Smart Cities2022 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events, PerCom Workshops 2022 (2022)
40037 View0.902Proietti Mattia G.; Beraldi R.Online Decentralized Scheduling In Fog Computing For Smart Cities Based On Reinforcement LearningIEEE Transactions on Cognitive Communications and Networking, 10, 4 (2024)
21373 View0.899Abdelghany H.M.Dynamic Resource Management And Task Offloading Framework For Fog ComputingJournal of Grid Computing, 23, 2 (2025)
23430 View0.894Sellami B.; Hakiri A.; Yahia S.B.; Berthou P.Energy-Aware Task Scheduling And Offloading Using Deep Reinforcement Learning In Sdn-Enabled Iot NetworkComputer Networks, 210 (2022)
26786 View0.89Al-Hashimi M.A.A.; Rahiman A.R.; Muhammed A.; Hamid N.A.W.Fog-Cloud Scheduling Simulator For Reinforcement Learning AlgorithmsInternational Journal of Information Technology (Singapore), 17, 5 (2025)
6353 View0.883Choppara P.; Mangalampalli S.S.Adaptive Task Scheduling In Fog Computing Using Federated Dqn And K-Means ClusteringIEEE Access, 13 (2025)
36528 View0.881Shruthi G.; Mundada M.R.; Sowmya B.J.; Supreeth S.Mayfly Taylor Optimisation-Based Scheduling Algorithm With Deep Reinforcement Learning For Dynamic Scheduling In Fog-Cloud ComputingApplied Computational Intelligence and Soft Computing, 2022 (2022)
18071 View0.879Bushehrian O.; Moazeni A.Deep Reinforcement Learning-Based Optimal Deployment Of Iot Machine Learning Jobs In Fog Computing ArchitectureComputing, 107, 1 (2025)
38114 View0.874Neelamegam G.; Venkatesan R.; Ramya S.R.; Ramya R.S.; Akshya J.; Sundarrajan M.; Choudhry M.D.Multi-Agent Systems For Autonomous Iot Network Management Using Distributed Reinforcement LearningProceedings of 2025 3rd International Conference on Intelligent Systems, Advanced Computing, and Communication, ISACC 2025 (2025)
46071 View0.868Cui X.Resource Allocation In Iot Edge Computing Networks Based On Reinforcement LearningAdvances in Transdisciplinary Engineering, 70 (2025)