Smart City Gnosys
Smart city article details
| Title | Ddpg-Edge-Cloud: A Deep-Deterministic Policy Gradient Based Multi-Resource Allocation In Edge-Cloud System |
|---|---|
| ID_Doc | 17582 |
| Authors | Qadeer A.; Lee M.J. |
| Year | 2022 |
| Published | 4th International Conference on Artificial Intelligence in Information and Communication, ICAIIC 2022 - Proceedings |
| DOI | http://dx.doi.org/10.1109/ICAIIC54071.2022.9722676 |
| Abstract | 5G and beyond is the key enabler for extreme mobile-broadband (xMBB), Massive and Ultra-reliable machine-type communication (mMTC, uMTC). To handle such large-scale and real-time traffics, Edge Cloud (EC) plays a critical role to minimize the latency and provide compute power at the edge of the network for Internet of Things (IoTs). However, an EC endures limited compute capacity in contrast with the back-end cloud (BC). Intelligent resource management techniques become imperative in such resource constrained environment. This paper studies the problem of compute and wireless resource allocation in an integrated EC and BC environment. Machine learning-based techniques are emerging to solve such optimization problems. However, it is challenging to adopt traditional discrete action space-based methods since they do not scale well in large-scale environments. To this end, to overcome the bottlenecks of wireless bandwidth and compute capacity in resource constrained EC and BC, we propose continuous action space-based DDPG-Edge-Cloud, a deep deterministic policy gradient-based multi-resource allocation (MRA) framework with a pruning principle. The proposed agent is equipped with a Conv1D residual block, gated recurrent unit (GRU) layer and an attention layer for local and long-term temporal feature extraction. We validate the proposed framework by comparing with two alternative agents. Experimental results demonstrate that our proposed agent converges fast and achieves up to 55% and 86.5% reduction in operational cost and rejection rate, and achieves up to 115% gain in the quality of experience on average. © 2022 IEEE. |
| Author Keywords | deep deterministic policy gradient; Edge cloud computing; IoT; resource allocation; smart city |
Similar Articles
| Id | Similarity | Authors | Title | Published |
|---|---|---|---|---|
18096  | 0.945 | Qadeer A.; Lee M.J. | Deep-Deterministic Policy Gradient Based Multi-Resource Allocation In Edge-Cloud System: A Distributed Approach | IEEE Access, 11 (2023) |
| 29545 | 0.879 | Qadeer A.; Lee M.J. | Hrl-Edge-Cloud: Multi-Resource Allocation In Edge-Cloud Based Smart-Streetscape System Using Heuristic Reinforcement Learning | Information Systems Frontiers, 26, 4 (2024) |
| 7415 | 0.879 | Moghaddasi K.; Rajabi S.; Gharehchopogh F.S.; Ghaffari A. | An Advanced Deep Reinforcement Learning Algorithm For Three-Layer D2D-Edge-Cloud Computing Architecture For Efficient Task Offloading In The Internet Of Things | Sustainable Computing: Informatics and Systems, 43 (2024) |
| 21374 | 0.878 | Wan X. | Dynamic Resource Management In Mec Powered By Edge Intelligence For Smart City Internet Of Things | Journal of Grid Computing, 22, 1 (2024) |
| 20631 | 0.877 | Li H.; Wang G.; Liu Y.; Ren S.; Li T.; Wang D. | Distributed Edge Computing Resource Allocation Algorithm Based On Drl In Lte Access Network | 4th International Conference on Smart Grid and Smart Cities, ICSGSC 2020 (2020) |
| 46071 | 0.87 | Cui X. | Resource Allocation In Iot Edge Computing Networks Based On Reinforcement Learning | Advances in Transdisciplinary Engineering, 70 (2025) |
| 14476 | 0.864 | Lilhore U.K.; Simaiya S.; Sharma Y.K.; Rai A.K.; Padmaja S.M.; Nabilal K.V.; Kumar V.; Alroobaea R.; Alsufyani H. | Cloud-Edge Hybrid Deep Learning Framework For Scalable Iot Resource Optimization | Journal of Cloud Computing, 14, 1 (2025) |
| 32524 | 0.863 | Vigenesh M.; Katyal A.; Hemalatha S.; Ahluwalia G.; Kukreja M.; Mathurkar P. | Intelligent Resource Scheduling For Edge-Integrated Iot Using Deep Learning | 2024 IEEE 4th International Conference on ICT in Business Industry and Government, ICTBIG 2024 (2024) |
| 23430 | 0.859 | Sellami B.; Hakiri A.; Yahia S.B.; Berthou P. | Energy-Aware Task Scheduling And Offloading Using Deep Reinforcement Learning In Sdn-Enabled Iot Network | Computer Networks, 210 (2022) |
| 26323 | 0.858 | Chen X.; Liu G. | Federated Deep Reinforcement Learning-Based Task Offloading And Resource Allocation For Smart Cities In A Mobile Edge Network | Sensors, 22, 13 (2022) |