Smart City Gnosys
Smart city article details
| Title | On The Limits Of Digital Twins For Safe Deep Reinforcement Learning In Robotic Networks |
|---|---|
| ID_Doc | 39876 |
| Authors | Balghouthi M.I.; Chiariotti F.; Bedogni L. |
| Year | 2024 |
| Published | IEEE INFOCOM 2024 - IEEE Conference on Computer Communications Workshops, INFOCOM WKSHPS 2024 |
| DOI | http://dx.doi.org/10.1109/INFOCOMWKSHPS61880.2024.10620857 |
| Abstract | Successfully training models which address the complex nature of real environments in Smart Cities and robotic networks is challenging, due to the vast amount of data needed. When employing Reinforcement Learning (RL) models, it is also impossible to let them explore all the actions in the real world, due to potential damages and inappropriate actions. The inherent trial-and-error nature of RL, especially in real-world applications like traffic management, makes an integration with Digital Twins (DTs) attractive: DTs provide a secure environment for iterative training and testing, ensuring the refinement of the models before testing. However, the use of DTs has some significant limitations, as the difference between the model and reality may cause significant risks. This study focuses on the adaptive and self-learning characteristics of this approach, considering a standard navigation task in a highway environment, and analyzes its advantages and potential pitfalls. © 2024 IEEE. |
| Author Keywords | - Digital Twin; Reinforcement Learning; transfer learning |
Similar Articles
| Id | Similarity | Authors | Title | Published |
|---|---|---|---|---|
20186  | 0.89 | Alhumud H.; Al Jubara G.A.; Alghafliy A.A.; Al-Anzi A.F.; Al Mohammed A.A. | Digital Twin Environment With Reinforcement Learning-Based On Traffic Control | 2025 2nd International Conference on Advanced Innovations in Smart Cities, ICAISC 2025 (2025) |
| 3016 | 0.865 | Mostaq Hossain S.M.; Saha S.K.; Banik S.; Banik T. | A New Era Of Mobility: Exploring Digital Twin Applications In Autonomous Vehicular Systems | 2023 IEEE World AI IoT Congress, AIIoT 2023 (2023) |
| 3396 | 0.858 | Kaur P.; Sobti R. | A Novel Hybrid Framework For Motion Planning In Autonomous Vehicles Using Reinforcement And Imitation Learning | CINS 2024 - 2nd International Conference on Computational Intelligence and Network Systems (2024) |
| 5324 | 0.856 | Qureshi A.R.; Asensio A.; Imran M.; Garcia J.; Masip-Bruin X. | A Survey On Security Enhancing Digital Twins: Models, Applications And Tools | Computer Communications, 238 (2025) |
| 7062 | 0.853 | Long K.; Ma C.; Li H.; Li Z.; Huang H.; Shi H.; Huang Z.; Sheng Z.; Shi L.; Li P.; Chen S.; Li X. | Ai-Enabled Digital Twin Framework For Safe And Sustainable Intelligent Transportation | Sustainability (Switzerland), 17, 10 (2025) |
| 6943 | 0.851 | Cakir L.V.; Duran K.; Thomson C.; Broadbent M.; Canberk B. | Ai In Energy Digital Twining: A Reinforcement Learning-Based Adaptive Digital Twin Model For Green Cities | IEEE International Conference on Communications (2024) |