Smart City Gnosys
Smart city article details
| Title | Urbanenqosplace: A Deep Reinforcement Learning Model For Service Placement Of Real-Time Smart City Iot Applications |
|---|---|
| ID_Doc | 60278 |
| Authors | Bansal M.; Chana I.; Clarke S. |
| Year | 2023 |
| Published | IEEE Transactions on Services Computing, 16, 4 |
| DOI | http://dx.doi.org/10.1109/TSC.2022.3218044 |
| Abstract | Multi-access Edge Computing (MEC) enables IoT applications to place their services in the edge servers of mobile networks, balancing Quality-of-Service (QoS) and energy-efficiency. Previous works consider compute requirements, while the IoT and latency/bandwidth per-flow communicate requirements are largely ignored. Moreover, the Smart City domain presents unique challenges - modeling the Urban Smart Things (USTs - urban IoT clients), their connectivity with MEC network, diverse resource requirements (compute, communicate, and IoT) of application services, modeling the federation of multiple MEC providers in a city, which we consider in this article. To address these research gaps, we propose: i) UrbanEnQoSMDP - formulation for energy and QoS (latency) optimized service placement for a set of applications in the 'Urban IoT-Federated MEC-Cloud' architecture to satisfy applications' compute, per-flow communicate, and IoT requirements; ii) ϵ-greedy with mask' policy for apriori satisfaction of IoT requirements by shortlisting suitable USTs; iii) UrbanEnQoSPlace - proposed multi-action Deep Reinforcement Learning (DRL) model, designed from Dueling Deep-Q Network, that uses the proposed policy to solve the UrbanEnQoSMDP for simultaneously placing all services of an application. Extensive simulation results illustrate efficacy and scalability of proposed model against state-of-the-art DRL algorithms (better convergence, higher rewards, lesser runtime; proposed policy w.r.t fewer violations). © 2008-2012 IEEE. |
| Author Keywords | AI for service placement in smart city; AI in IoT; DRL; dueling DQN; IoT service placement; smart city |
Similar Articles
| Id | Similarity | Authors | Title | Published |
|---|---|---|---|---|
46071  | 0.905 | Cui X. | Resource Allocation In Iot Edge Computing Networks Based On Reinforcement Learning | Advances in Transdisciplinary Engineering, 70 (2025) |
| 26323 | 0.894 | Chen X.; Liu G. | Federated Deep Reinforcement Learning-Based Task Offloading And Resource Allocation For Smart Cities In A Mobile Edge Network | Sensors, 22, 13 (2022) |
| 21789 | 0.889 | Tian K.; Chai H.; Liu Y.; Liu B. | Edge Intelligence Empowered Dynamic Offloading And Resource Management Of Mec For Smart City Internet Of Things | Electronics (Switzerland), 11, 6 (2022) |
| 18071 | 0.888 | Bushehrian O.; Moazeni A. | Deep Reinforcement Learning-Based Optimal Deployment Of Iot Machine Learning Jobs In Fog Computing Architecture | Computing, 107, 1 (2025) |
| 7415 | 0.886 | Moghaddasi K.; Rajabi S.; Gharehchopogh F.S.; Ghaffari A. | An Advanced Deep Reinforcement Learning Algorithm For Three-Layer D2D-Edge-Cloud Computing Architecture For Efficient Task Offloading In The Internet Of Things | Sustainable Computing: Informatics and Systems, 43 (2024) |
| 23430 | 0.883 | Sellami B.; Hakiri A.; Yahia S.B.; Berthou P. | Energy-Aware Task Scheduling And Offloading Using Deep Reinforcement Learning In Sdn-Enabled Iot Network | Computer Networks, 210 (2022) |
| 34433 | 0.881 | Yao R.; Liu L.; Zuo X.; Yu L.; Xu J.; Fan Y.; Li W. | Joint Task Offloading And Power Control Optimization For Iot-Enabled Smart Cities: An Energy-Efficient Coordination Via Deep Reinforcement Learning | IEEE Transactions on Consumer Electronics (2025) |
| 37003 | 0.881 | Boudieb W.; Malki A.; Malki M.; Badawy A.; Barhamgi M. | Microservice Instances Selection And Load Balancing In Fog Computing Using Deep Reinforcement Learning Approach | Future Generation Computer Systems, 156 (2024) |
| 18054 | 0.878 | Zhang Y.; Wang L.; Liang W. | Deep Reinforcement Learning For Mobility-Aware Digital Twin Migrations In Edge Computing | IEEE Transactions on Services Computing, 18, 2 (2025) |
| 18069 | 0.877 | Li W.; Chen X.; Jiao L.; Wang Y. | Deep Reinforcement Learning-Based Intelligent Task Offloading And Dynamic Resource Allocation In 6G Smart City | Proceedings - IEEE Symposium on Computers and Communications, 2023-July (2023) |