Smart City Gnosys
Smart city article details
| Title | Deep-Deterministic Policy Gradient Based Multi-Resource Allocation In Edge-Cloud System: A Distributed Approach |
|---|---|
| ID_Doc | 18096 |
| Authors | Qadeer A.; Lee M.J. |
| Year | 2023 |
| Published | IEEE Access, 11 |
| DOI | http://dx.doi.org/10.1109/ACCESS.2023.3249153 |
| Abstract | Edge Cloud (EC) empowers the beyond 5G (B5G) wireless networks to cope with large-scale and real-time traffics of Internet-of-Things (IoT) by minimizing the latency and providing compute power at the edge of the network. Due to a limited amount of resources at the EC compared to the back-end cloud (BC), intelligent resource management techniques become imperative. This paper studies the problem of multi-resource allocation (MRA) in terms of compute and wireless resources in an integrated EC and BC environment. Machine learning-based approaches are emerging to solve such optimization problems. However, it is challenging to adopt traditional discrete action space-based methods due to their high dimensionality issue. To this end, we propose a deep-deterministic policy gradient (DDPG) based temporal feature learning attentional network (TFLAN) model to address the MRA problem. TFLAN combines convolution, gated recurrent unit and attention layers together to mine local and long term temporal information from the task sequences for excellent function approximation. A novel heuristic-based priority experience replay (hPER) method is formulated to accelerate the convergence speed. Further, a pruning principle helps the TFLAN agent to significantly reduce the computational complexity and balance the load among base stations and servers to minimize the rejection-rate. Lastly, data parallelism technique is adopted for distributed training to meet the needs of a high-volume of IoT traffic in the EC environment. Experimental results demonstrate that the distributed training approach suites well to the problem scale and can magnify the speed of the learning process. We validate the proposed framework by comparing with five state-of-the-art RL agents. Our proposed agent converges fast and achieves up to 28% and 72% reduction in operational cost and rejection-rate, and achieves up to 32% gain in the quality of experience on average, compared to the most advanced DDPG agent. © 2013 IEEE. |
| Author Keywords | beyond 5G; deep deterministic policy gradient; distributed training; Edge cloud computing; heuristic priority experience replay; IoT; resource allocation; smart city; wireless networks |
Similar Articles
| Id | Similarity | Authors | Title | Published |
|---|---|---|---|---|
17582  | 0.945 | Qadeer A.; Lee M.J. | Ddpg-Edge-Cloud: A Deep-Deterministic Policy Gradient Based Multi-Resource Allocation In Edge-Cloud System | 4th International Conference on Artificial Intelligence in Information and Communication, ICAIIC 2022 - Proceedings (2022) |
| 7415 | 0.893 | Moghaddasi K.; Rajabi S.; Gharehchopogh F.S.; Ghaffari A. | An Advanced Deep Reinforcement Learning Algorithm For Three-Layer D2D-Edge-Cloud Computing Architecture For Efficient Task Offloading In The Internet Of Things | Sustainable Computing: Informatics and Systems, 43 (2024) |
| 46071 | 0.891 | Cui X. | Resource Allocation In Iot Edge Computing Networks Based On Reinforcement Learning | Advances in Transdisciplinary Engineering, 70 (2025) |
| 32524 | 0.889 | Vigenesh M.; Katyal A.; Hemalatha S.; Ahluwalia G.; Kukreja M.; Mathurkar P. | Intelligent Resource Scheduling For Edge-Integrated Iot Using Deep Learning | 2024 IEEE 4th International Conference on ICT in Business Industry and Government, ICTBIG 2024 (2024) |
| 14476 | 0.888 | Lilhore U.K.; Simaiya S.; Sharma Y.K.; Rai A.K.; Padmaja S.M.; Nabilal K.V.; Kumar V.; Alroobaea R.; Alsufyani H. | Cloud-Edge Hybrid Deep Learning Framework For Scalable Iot Resource Optimization | Journal of Cloud Computing, 14, 1 (2025) |
| 29545 | 0.887 | Qadeer A.; Lee M.J. | Hrl-Edge-Cloud: Multi-Resource Allocation In Edge-Cloud Based Smart-Streetscape System Using Heuristic Reinforcement Learning | Information Systems Frontiers, 26, 4 (2024) |
| 23430 | 0.886 | Sellami B.; Hakiri A.; Yahia S.B.; Berthou P. | Energy-Aware Task Scheduling And Offloading Using Deep Reinforcement Learning In Sdn-Enabled Iot Network | Computer Networks, 210 (2022) |
| 20631 | 0.874 | Li H.; Wang G.; Liu Y.; Ren S.; Li T.; Wang D. | Distributed Edge Computing Resource Allocation Algorithm Based On Drl In Lte Access Network | 4th International Conference on Smart Grid and Smart Cities, ICSGSC 2020 (2020) |
| 26323 | 0.873 | Chen X.; Liu G. | Federated Deep Reinforcement Learning-Based Task Offloading And Resource Allocation For Smart Cities In A Mobile Edge Network | Sensors, 22, 13 (2022) |
| 34376 | 0.868 | Wang H.; Chen X.; Xu H.; Liu J.; Huang L. | Joint Job Offloading And Resource Allocation For Distributed Deep Learning In Edge Computing | Proceedings - 21st IEEE International Conference on High Performance Computing and Communications, 17th IEEE International Conference on Smart City and 5th IEEE International Conference on Data Science and Systems, HPCC/SmartCity/DSS 2019 (2019) |