Smart City Gnosys
Smart city article details
| Title | Hybrid Learning For Orchestrating Deep Learning Inference In Multi-User Edge-Cloud Networks |
|---|---|
| ID_Doc | 29768 |
| Authors | Shahhosseini S.; Hu T.; Seo D.; Kanduri A.; Donyanavard B.; Rahmani A.M.; Dutt N. |
| Year | 2022 |
| Published | Proceedings - International Symposium on Quality Electronic Design, ISQED, 2022-April |
| DOI | http://dx.doi.org/10.1109/ISQED54688.2022.9806291 |
| Abstract | Deep-learning-based intelligent services have become prevalent in cyber-physical applications including smart cities and health-care. Collaborative end-edge-cloud computing for deep learning provides a range of performance and efficiency that can address application requirements through computation offloading. The decision to offload computation is a communication-computation co-optimization problem that varies with both system parameters (e.g., network condition) and workload characteristics (e.g., inputs). Identifying optimal orchestration considering the cross-layer opportunities and requirements in the face of varying system dynamics is a challenging multi-dimensional problem. While Reinforcement Learning (RL) approaches have been proposed earlier, they suffer from a large number of trial-and-errors during the learning process resulting in excessive time and resource consumption. We present a Hybrid Learning orchestration framework that reduces the number of interactions with the system environment by combining model-based and model-free reinforcement learning. Our Deep Learning inference orchestration strategy employs reinforcement learning to find the optimal orchestration policy. Furthermore, we deploy Hybrid Learning (HL) to accelerate the RL learning process and reduce the number of direct samplings. We demonstrate efficacy of our HL strategy through experimental comparison with state-of-the-art RL-based inference orchestration, demonstrating that our HL strategy accelerates the learning process by up to 166.6×. © 2022 IEEE. |
| Author Keywords |
Similar Articles
| Id | Similarity | Authors | Title | Published |
|---|---|---|---|---|
40058  | 0.924 | Shahhosseini S.; Seo D.; Kanduri A.; Hu T.; Lim S.-S.; Donyanavard B.; Rahmani A.M.; Dutt N. | Online Learning For Orchestration Of Inference In Multi-User End-Edge-Cloud Networks | ACM Transactions on Embedded Computing Systems, 21, 6 (2022) |
| 7415 | 0.864 | Moghaddasi K.; Rajabi S.; Gharehchopogh F.S.; Ghaffari A. | An Advanced Deep Reinforcement Learning Algorithm For Three-Layer D2D-Edge-Cloud Computing Architecture For Efficient Task Offloading In The Internet Of Things | Sustainable Computing: Informatics and Systems, 43 (2024) |
| 46071 | 0.855 | Cui X. | Resource Allocation In Iot Edge Computing Networks Based On Reinforcement Learning | Advances in Transdisciplinary Engineering, 70 (2025) |
| 43827 | 0.855 | Hosseinzadeh M.; Wachal A.; Khamfroush H.; Lucani D.E. | Qos-Aware Priority-Based Task Offloading For Deep Learning Services At The Edge | Proceedings - IEEE Consumer Communications and Networking Conference, CCNC (2022) |
| 21063 | 0.852 | He B.; Li H.; Chen T. | Drl-Based Computing Offloading Approach For Large-Scale Heterogeneous Tasks In Mobile Edge Computing | Concurrency and Computation: Practice and Experience, 36, 19 (2024) |
| 34376 | 0.852 | Wang H.; Chen X.; Xu H.; Liu J.; Huang L. | Joint Job Offloading And Resource Allocation For Distributed Deep Learning In Edge Computing | Proceedings - 21st IEEE International Conference on High Performance Computing and Communications, 17th IEEE International Conference on Smart City and 5th IEEE International Conference on Data Science and Systems, HPCC/SmartCity/DSS 2019 (2019) |