Smart City Gnosys
Smart city article details
| Title | Deep Reinforcement Learning For Mobility-Aware Digital Twin Migrations In Edge Computing |
|---|---|
| ID_Doc | 18054 |
| Authors | Zhang Y.; Wang L.; Liang W. |
| Year | 2025 |
| Published | IEEE Transactions on Services Computing, 18, 2 |
| DOI | http://dx.doi.org/10.1109/TSC.2025.3528331 |
| Abstract | The past decade witnessed an explosive growth on the number of IoT devices (objects/suppliers), including portable mobile devices, autonomous vehicles, sensors and intelligence appliances. To realize the digital representations of objects, Digital Twins (DTs) are key enablers to provide real-time monitoring, behavior simulations and predictive decisions for objects. On the other hand, Mobile Edge Computing (MEC) has been envisioned as a promising paradigm to provide delay-sensitive services for mobile users (consumers) at the network edge, e.g., real-time healthcare, AR/VR, online gaming, smart cities, and so on. In this paper, we study a novel DT migration problem for high quality service provisioning in an MEC network with the mobility of both suppliers and consumers for a finite time horizon, with the aim to minimize the sum of the accumulative DT synchronization cost of all suppliers and the total service cost of all consumers requesting for different DT services. To this end, we first show that the problem is NP-hard, and formulate an integer linear programming solution to the offline version of the problem. We then develop a Deep Reinforcement Learning (DRL) algorithm for the DT migration problem, by considering the system dynamics and heterogeneity of different resource consumptions, mobility traces of both suppliers and consumers, and workloads of cloudlets. We finally evaluate the performance of the proposed algorithms through experimental simulations. Simulation results demonstrate that the proposed algorithms are promising. © 2008-2012 IEEE. |
| Author Keywords | cost modeling of DT migration; deep reinforcement learning algorithm; Digital twin synchronization; mobile edge computing; mobility-aware DT migration |
Similar Articles
| Id | Similarity | Authors | Title | Published |
|---|---|---|---|---|
40621  | 0.884 | Hassan M.T.; Hosain M.K. | Optimization Of Computation Offloading In Mobile-Edge Computing Networks With Deep Reinforcement Approach | 2024 IEEE International Conference on Communication, Computing and Signal Processing, IICCCS 2024 (2024) |
| 38627 | 0.883 | Liang X.; Liang W.; Xu Z.; Zhang Y.; Jia X. | Multiple Service Model Refreshments In Digital Twin-Empowered Edge Computing | IEEE Transactions on Services Computing, 17, 5 (2024) |
| 46071 | 0.879 | Cui X. | Resource Allocation In Iot Edge Computing Networks Based On Reinforcement Learning | Advances in Transdisciplinary Engineering, 70 (2025) |
| 60278 | 0.878 | Bansal M.; Chana I.; Clarke S. | Urbanenqosplace: A Deep Reinforcement Learning Model For Service Placement Of Real-Time Smart City Iot Applications | IEEE Transactions on Services Computing, 16, 4 (2023) |
| 21063 | 0.875 | He B.; Li H.; Chen T. | Drl-Based Computing Offloading Approach For Large-Scale Heterogeneous Tasks In Mobile Edge Computing | Concurrency and Computation: Practice and Experience, 36, 19 (2024) |
| 14480 | 0.875 | Ranjbaran S.; Amadeo M.; Marche C.; Ruggeri G.; Sinha A.; Nitti M. | Cloud-Edge Resource Management And Migration: Leveraging Online Learning For Digital Twin Re-Placement | 2024 IEEE 10th World Forum on Internet of Things, WF-IoT 2024 (2024) |
| 38090 | 0.874 | Jiao T.; Feng X.; Guo C.; Wang D.; Song J. | Multi-Agent Deep Reinforcement Learning For Efficient Computation Offloading In Mobile Edge Computing | Computers, Materials and Continua, 76, 3 (2023) |
| 62053 | 0.873 | Li S.; Zhou Y.; Zhou B.; Wang Z. | Workload-Based Adaptive Decision-Making For Edge Server Layout With Deep Reinforcement Learning | Engineering Applications of Artificial Intelligence, 139 (2025) |
| 7415 | 0.871 | Moghaddasi K.; Rajabi S.; Gharehchopogh F.S.; Ghaffari A. | An Advanced Deep Reinforcement Learning Algorithm For Three-Layer D2D-Edge-Cloud Computing Architecture For Efficient Task Offloading In The Internet Of Things | Sustainable Computing: Informatics and Systems, 43 (2024) |
| 54442 | 0.868 | Zhao X.; Liu M.; Li M. | Task Offloading Strategy And Scheduling Optimization For Internet Of Vehicles Based On Deep Reinforcement Learning | Ad Hoc Networks, 147 (2023) |