Smart City Gnosys

Smart city article details

Title Partial Distributed Deep Learning Inference Model For Image Based Edge Device Cluster
ID_Doc 41334
Authors Xiao D.; Wang X.; Yang Z.; Huang C.
Year 2025
Published Proceedings of 2024 8th International Conference on Electronic Information Technology and Computer Engineering, EITCE 2024
DOI http://dx.doi.org/10.1145/3711129.3711149
Abstract In recent years, the development of AI technology has driven the development of network edge applications such as smart manufacturing, smart factories, and smart cities. Deep neural networks are increasingly being deployed in smart manufacturing edge application scenarios to carry out edge detection tasks. However, there is a gap between the expensive DNN computing network and the limited computing power of the edge devices. To deploy compute-intensive neural networks on resource-constrained edge devices, traditional approaches rely either on offloading workloads to a remote central cloud or on optimizing compute on local edge devices. However, the method of uploading tasks to the central cloud is significantly affected by the unreliability and delay of the WAN, and the sensitive information of users is easy to be leaked during transmission, and the local computing method is also limited by the computing power. The latest machine learning models have great demands on memory, computing, and energy, which poses challenges to distributed computing and data aggregation for heterogeneous and resource-constrained edge devices. In order to address these challenges, this paper proposes solutions for different image types in intelligent manufacturing scenarios. When images are processed in the production process of intelligent manufacturing, this paper adopts the method of horizontal partitioning of the DNN model to perform DNN-based inference tasks on the edge device cluster. In order to reduce the consumption of network bandwidth, a dynamic priority scheduling algorithm is used to optimize the distribution of inference tasks at the edge nodes to improve the inference speed. Finally, experiments show that the edge node optimization scheduling method proposed in this paper has a good effect on the performance of running time, communication cost and energy consumption of edge devices. © 2024 Copyright held by the owner/author(s).
Author Keywords data partitioning; deep learning; distributed computing; Edge computing; task scheduling


Similar Articles


Id Similarity Authors Title Published
21859 View0.914Xue F.; Fang W.; Xu W.; Wang Q.; Ma X.; Ding Y.Edgeld: Locally Distributed Deep Learning Inference On Edge Device ClustersProceedings - 2020 IEEE 22nd International Conference on High Performance Computing and Communications, IEEE 18th International Conference on Smart City and IEEE 6th International Conference on Data Science and Systems, HPCC-SmartCity-DSS 2020 (2020)
20553 View0.912Li Q.; Huang L.; Tong Z.; Du T.-T.; Zhang J.; Wang S.-C.Dissec: A Distributed Deep Neural Network Inference Scheduling Strategy For Edge ClustersNeurocomputing, 500 (2022)
34376 View0.892Wang H.; Chen X.; Xu H.; Liu J.; Huang L.Joint Job Offloading And Resource Allocation For Distributed Deep Learning In Edge ComputingProceedings - 21st IEEE International Conference on High Performance Computing and Communications, 17th IEEE International Conference on Smart City and 5th IEEE International Conference on Data Science and Systems, HPCC/SmartCity/DSS 2019 (2019)
5251 View0.873Hoffpauir K.; Simmons J.; Schmidt N.; Pittala R.; Briggs I.; Makani S.; Jararweh Y.A Survey On Edge Intelligence And Lightweight Machine Learning Support For Future Applications And ServicesJournal of Data and Information Quality, 15, 2 (2023)
21857 View0.873Chen Y.; Luo T.; Fang W.; Xiong N.N.Edgeci: Distributed Workload Assignment And Model Partitioning For Cnn Inference On Edge ClustersACM Transactions on Internet Technology, 24, 2 (2024)
13948 View0.87Zhang Z.; Li F.; Lin C.; Wen S.; Liu X.; Liu J.Choosing Appropriate Ai-Enabled Edge Devices, Not The Costly OnesProceedings of the International Conference on Parallel and Distributed Systems - ICPADS, 2021-December (2021)
6307 View0.866Zhou L.; Samavatian M.H.; Bacha A.; Majumdar S.; Teodorescu R.Adaptive Parallel Execution Of Deep Neural Networks On Heterogeneous Edge DevicesProceedings of the 4th ACM/IEEE Symposium on Edge Computing, SEC 2019 (2019)
29005 View0.861Ilhan F.; Tekin S.F.; Hu S.; Huang T.; Chow K.-H.; Liu L.Hierarchical Deep Neural Network Inference For Device-Edge-Cloud SystemsACM Web Conference 2023 - Companion of the World Wide Web Conference, WWW 2023 (2023)
32524 View0.861Vigenesh M.; Katyal A.; Hemalatha S.; Ahluwalia G.; Kukreja M.; Mathurkar P.Intelligent Resource Scheduling For Edge-Integrated Iot Using Deep Learning2024 IEEE 4th International Conference on ICT in Business Industry and Government, ICTBIG 2024 (2024)
13852 View0.86Prashanthi S.K.; Kesanapalli S.A.; Simmhan Y.Characterizing The Performance Of Accelerated Jetson Edge Devices For Training Deep Learning ModelsProceedings of the ACM on Measurement and Analysis of Computing Systems, 6, 3 (2022)