Smart City Gnosys

Smart city article details

Title	Hrl-Edge-Cloud: Multi-Resource Allocation In Edge-Cloud Based Smart-Streetscape System Using Heuristic Reinforcement Learning
ID_Doc	29545
Authors	Qadeer A.; Lee M.J.
Year	2024
Published	Information Systems Frontiers, 26, 4
DOI	http://dx.doi.org/10.1007/s10796-022-10366-2
Abstract	The Edge Cloud (EC) architecture aims at providing the compute power at the edge of the network to minimize the latency necessary for the Internet of Things (IoT). However, an EC endures a limited compute capacity in contrast with the back-end cloud (BC). Intelligent resource management techniques become imperative in such resource constrained environment. In this study, to achieve the efficient resource allocation objective, we propose HRL-Edge-Cloud, a novel heuristic reinforcement learning-based multi-resource allocation (MRA) framework which significantly overcomes the bottlenecks of wireless bandwidth and compute capacity jointly at the EC and BC. We solve the MRA problem by accelerating the conventional Q-Learning algorithm with a heuristic method and applying a novel linear-annealing technique. Additionally, our proposed pruning principle achieves remarkably high resource utilization efficiency while maintaining a low rejection rate. The effectiveness of our proposed method is validated by running extensive simulations in three different scales of environments. When compared with the baseline algorithm, the proposed HRL-Edge-Cloud achieves 240X, 95X and 2.4X reduction in runtime, convergence time and rejection rate, respectively, and achieves 2.34X operational cost efficiency improvement on average while satisfying the latency requirement. © The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2023.
Author Keywords	Admission control; Edge cloud; Heuristic reinforcement learning; IoT; Resource allocation; Smart city; Task offloading

Similar Articles

Id	Similarity	Authors	Title	Published
46071	0.888	Cui X.	Resource Allocation In Iot Edge Computing Networks Based On Reinforcement Learning	Advances in Transdisciplinary Engineering, 70 (2025)
18096	0.887	Qadeer A.; Lee M.J.	Deep-Deterministic Policy Gradient Based Multi-Resource Allocation In Edge-Cloud System: A Distributed Approach	IEEE Access, 11 (2023)
17582	0.879	Qadeer A.; Lee M.J.	Ddpg-Edge-Cloud: A Deep-Deterministic Policy Gradient Based Multi-Resource Allocation In Edge-Cloud System	4th International Conference on Artificial Intelligence in Information and Communication, ICAIIC 2022 - Proceedings (2022)
2288	0.879	Sahoo S.; Sahoo K.S.; Sahoo B.; Gandomi A.H.	A Learning Automata Based Edge Resource Allocation Approach For Iot-Enabled Smart Cities	Digital Communications and Networks, 10, 5 (2024)
7415	0.878	Moghaddasi K.; Rajabi S.; Gharehchopogh F.S.; Ghaffari A.	An Advanced Deep Reinforcement Learning Algorithm For Three-Layer D2D-Edge-Cloud Computing Architecture For Efficient Task Offloading In The Internet Of Things	Sustainable Computing: Informatics and Systems, 43 (2024)
23505	0.876	Rey-Jouanchicot J.; Lorenzo Del Castillo J.A.; Zuckerman S.; Belmega E.V.	Energy-Efficient Online Resource Provisioning For Cloud-Edge Platforms Via Multi-Armed Bandits	Proceedings - Symposium on Computer Architecture and High Performance Computing, 2022-November (2022)
27955	0.875	Chen Y.; Ding Y.; Hu Z.-Z.; Ren Z.	Geometrized Task Scheduling And Adaptive Resource Allocation For Large-Scale Edge Computing In Smart Cities	IEEE Internet of Things Journal (2025)
60278	0.867	Bansal M.; Chana I.; Clarke S.	Urbanenqosplace: A Deep Reinforcement Learning Model For Service Placement Of Real-Time Smart City Iot Applications	IEEE Transactions on Services Computing, 16, 4 (2023)
20630	0.865	Mahmood O.A.; Abdellah A.R.; Muthanna A.; Koucheryavy A.	Distributed Edge Computing For Resource Allocation In Smart Cities Based On The Iot	Information (Switzerland), 13, 7 (2022)
45588	0.865	Wang Y.; Wang D.; Lin G.; Zheng B.; Luo L.; Li S.	Research On Resource Scheduling And Optimization Strategies Of Edge Computing-Based 5G Networks In Smart City Applications	2023 4th International Symposium on Computer Engineering and Intelligent Communications, ISCEIC 2023 (2023)