Smart City Gnosys

Smart city article details

Title	Joint Job Offloading And Resource Allocation For Distributed Deep Learning In Edge Computing
ID_Doc	34376
Authors	Wang H.; Chen X.; Xu H.; Liu J.; Huang L.
Year	2019
Published	Proceedings - 21st IEEE International Conference on High Performance Computing and Communications, 17th IEEE International Conference on Smart City and 5th IEEE International Conference on Data Science and Systems, HPCC/SmartCity/DSS 2019
DOI	http://dx.doi.org/10.1109/HPCC/SmartCity/DSS.2019.00109
Abstract	Under the paradigm of Edge Computing, the enormous data generated at the network edge can be processed locally. Machine learning methods are often adopted to make full utilization of these data, among which the deep learning is a promising one. When considering the inherent distributed feature of these data, it is appeal to conduct distributed deep learning tasks directly at the edge. We focus on an edge computing system that conduct distributed deep learning tasks using gradient descent based approaches. To ensure the system's performance, there are at least two major challenges to cope with: how to offload the training jobs with multiple data source nodes and how to allocate the limited resources on each edge server among training jobs. In this paper, we jointly consider the two challenges, aiming to maximize the system throughput while ensuring the system's quality of service (QoS). We formulate the joint problem as an integer non-linear program and propose an efficient approximation algorithm based on reformulation and randomized rounding technique. Simulation results prove that the proposed algorithm can improve 56% of the system throughput and 53% of resource utilization when compared to the conventional baseline algorithms. © 2019 IEEE.
Author Keywords	Distributed deep learning; Edge computing; Job offloading; Resource allocation

Similar Articles

Id	Similarity	Authors	Title	Published
41334	0.892	Xiao D.; Wang X.; Yang Z.; Huang C.	Partial Distributed Deep Learning Inference Model For Image Based Edge Device Cluster	Proceedings of 2024 8th International Conference on Electronic Information Technology and Computer Engineering, EITCE 2024 (2025)
42904	0.885	Wang N.; Zhou R.; Jiao L.; Zhang R.; Li B.; Li Z.	Preemptive Scheduling For Distributed Machine Learning Jobs In Edge-Cloud Networks	IEEE Journal on Selected Areas in Communications, 40, 8 (2022)
34322	0.88	Li H.; Sun T.; Li X.; Xu H.	Job Placement Strategy With Opportunistic Resource Sharing For Distributed Deep Learning Clusters	Proceedings - 2020 IEEE 22nd International Conference on High Performance Computing and Communications, IEEE 18th International Conference on Smart City and IEEE 6th International Conference on Data Science and Systems, HPCC-SmartCity-DSS 2020 (2020)
40058	0.879	Shahhosseini S.; Seo D.; Kanduri A.; Hu T.; Lim S.-S.; Donyanavard B.; Rahmani A.M.; Dutt N.	Online Learning For Orchestration Of Inference In Multi-User End-Edge-Cloud Networks	ACM Transactions on Embedded Computing Systems, 21, 6 (2022)
21859	0.878	Xue F.; Fang W.; Xu W.; Wang Q.; Ma X.; Ding Y.	Edgeld: Locally Distributed Deep Learning Inference On Edge Device Clusters	Proceedings - 2020 IEEE 22nd International Conference on High Performance Computing and Communications, IEEE 18th International Conference on Smart City and IEEE 6th International Conference on Data Science and Systems, HPCC-SmartCity-DSS 2020 (2020)
20553	0.875	Li Q.; Huang L.; Tong Z.; Du T.-T.; Zhang J.; Wang S.-C.	Dissec: A Distributed Deep Neural Network Inference Scheduling Strategy For Edge Clusters	Neurocomputing, 500 (2022)
43827	0.874	Hosseinzadeh M.; Wachal A.; Khamfroush H.; Lucani D.E.	Qos-Aware Priority-Based Task Offloading For Deep Learning Services At The Edge	Proceedings - IEEE Consumer Communications and Networking Conference, CCNC (2022)
14625	0.869	Jiang Z.; Ling N.; Huang X.; Shi S.; Wu C.; Zhao X.; Yan Z.; Xing G.	Coedge: A Cooperative Edge System For Distributed Real-Time Deep Learning Tasks	IPSN 2023 - Proceedings of the 2023 22nd International Conference on Information Processing in Sensor Networks (2023)
18096	0.868	Qadeer A.; Lee M.J.	Deep-Deterministic Policy Gradient Based Multi-Resource Allocation In Edge-Cloud System: A Distributed Approach	IEEE Access, 11 (2023)
5251	0.867	Hoffpauir K.; Simmons J.; Schmidt N.; Pittala R.; Briggs I.; Makani S.; Jararweh Y.	A Survey On Edge Intelligence And Lightweight Machine Learning Support For Future Applications And Services	Journal of Data and Information Quality, 15, 2 (2023)