Smart City Gnosys
Smart city article details
| Title | Hierarchical Deep Neural Network Inference For Device-Edge-Cloud Systems |
|---|---|
| ID_Doc | 29005 |
| Authors | Ilhan F.; Tekin S.F.; Hu S.; Huang T.; Chow K.-H.; Liu L. |
| Year | 2023 |
| Published | ACM Web Conference 2023 - Companion of the World Wide Web Conference, WWW 2023 |
| DOI | http://dx.doi.org/10.1145/3543873.3587370 |
| Abstract | Edge computing and cloud computing have been utilized in many AI applications in various fields, such as computer vision, NLP, autonomous driving, and smart cities. To benefit from the advantages of both paradigms, we introduce HiDEC, a hierarchical deep neural network (DNN) inference framework with three novel features. First, HiDEC enables the training of a resource-adaptive DNN through the injection of multiple early exits. Second, HiDEC provides a latency-aware inference scheduler, which determines which input samples should exit locally on an edge device based on the exit scores, enabling inference on edge devices with insufficient resources to run the full model. Third, we introduce a dual thresholding approach allowing both easy and difficult samples to exit early. Our experiments on image and text classification benchmarks show that HiDEC significantly outperforms existing solutions. © 2023 Owner/Author. |
| Author Keywords | distributed systems; edge computing; neural networks |
Similar Articles
| Id | Similarity | Authors | Title | Published |
|---|---|---|---|---|
21859  | 0.875 | Xue F.; Fang W.; Xu W.; Wang Q.; Ma X.; Ding Y. | Edgeld: Locally Distributed Deep Learning Inference On Edge Device Clusters | Proceedings - 2020 IEEE 22nd International Conference on High Performance Computing and Communications, IEEE 18th International Conference on Smart City and IEEE 6th International Conference on Data Science and Systems, HPCC-SmartCity-DSS 2020 (2020) |
| 41334 | 0.861 | Xiao D.; Wang X.; Yang Z.; Huang C. | Partial Distributed Deep Learning Inference Model For Image Based Edge Device Cluster | Proceedings of 2024 8th International Conference on Electronic Information Technology and Computer Engineering, EITCE 2024 (2025) |
| 20553 | 0.859 | Li Q.; Huang L.; Tong Z.; Du T.-T.; Zhang J.; Wang S.-C. | Dissec: A Distributed Deep Neural Network Inference Scheduling Strategy For Edge Clusters | Neurocomputing, 500 (2022) |
| 21857 | 0.858 | Chen Y.; Luo T.; Fang W.; Xiong N.N. | Edgeci: Distributed Workload Assignment And Model Partitioning For Cnn Inference On Edge Clusters | ACM Transactions on Internet Technology, 24, 2 (2024) |
| 5251 | 0.851 | Hoffpauir K.; Simmons J.; Schmidt N.; Pittala R.; Briggs I.; Makani S.; Jararweh Y. | A Survey On Edge Intelligence And Lightweight Machine Learning Support For Future Applications And Services | Journal of Data and Information Quality, 15, 2 (2023) |