Smart City Gnosys
Smart city article details
| Title | Characterizing The Performance Of Accelerated Jetson Edge Devices For Training Deep Learning Models |
|---|---|
| ID_Doc | 13851 |
| Authors | Prashanthi S.K.; Kesanapalli S.A.; Simmhan Y. |
| Year | 2023 |
| Published | Performance Evaluation Review, 51, 1 |
| DOI | http://dx.doi.org/10.1145/3606376.3593530 |
| Abstract | Deep Neural Network (DNN) models are becoming ubiquitous in a variety of contemporary domains such as Autonomous Vehicles, Smart cities and Healthcare. They help drones to navigate, identify suspicious activities from safety cameras, and perform diagnostics over medical imaging. Fast DNN inferencing close to the data source is enabled by a growing class of accelerated edge devices such as NVIDIA Jetson and Google Coral which host low-power Graphics Processing Units (GPUs) and Tensor Processing Units (TPUs) along with ARM CPUs in a compact form-factor to offer a superior performance-to-energy ratio. E.g., the NVIDIA Jetson AGX Xavier kit has a 512-core Volta GPU, an 8-core ARM CPU and 32GB LPDDR4x memory, that operates within 65W of power, costs US999 and is smaller than a paperback novel. Recently, there has been a push towards training DNN models on the edge [2]. This is driven by the massive growth in data collected from edge devices in Cyber-Physical Systems (CPS) and Internet of Things (IoT), the need to refresh the models periodically, the bandwidth constraints in moving all this data to Cloud data centers for training, and a heightened emphasis on privacy by retaining data on the edge. This has led to techniques like federated and geo-distributed learning that train DNN models locally on data on an edge device and aggregate them centrally. In this abstract, we summarise and highlight key results from our full paper [5]. © 2023 Owner/Author. |
| Author Keywords | dnn training; edge accelerators; performance characterization |
Similar Articles
| Id | Similarity | Authors | Title | Published |
|---|---|---|---|---|
13850  | 1 | Prashanthi S.K.; Kesanapalli S.A.; Simmhan Y. | Characterizing The Performance Of Accelerated Jetson Edge Devices For Training Deep Learning Models | SIGMETRICS 2023 - Abstract Proceedings of the 2023 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems (2023) |
| 13852 | 0.964 | Prashanthi S.K.; Kesanapalli S.A.; Simmhan Y. | Characterizing The Performance Of Accelerated Jetson Edge Devices For Training Deep Learning Models | Proceedings of the ACM on Measurement and Analysis of Computing Systems, 6, 3 (2022) |
| 11308 | 0.886 | Gutierrez-Torre A.; Bahadori K.; Baig S.-U.-R.; Iqbal W.; Vardanega T.; Berral J.L.; Carrera D. | Automatic Distributed Deep Learning Using Resource-Constrained Edge Devices | IEEE Internet of Things Journal, 9, 16 (2022) |
| 21736 | 0.857 | Anchitaalagammai J.V.; Kavitha S.; Buurvidha R.; Santhiya T.S.; Roopa M.D.; Sankari S.S. | Edge Artificial Intelligence For Real-Time Decision Making Using Nvidia Jetson Orin, Google Coral Edge Tpu And 6G For Privacy And Scalability | Proceedings of International Conference on Visual Analytics and Data Visualization, ICVADV 2025 (2025) |
| 21859 | 0.853 | Xue F.; Fang W.; Xu W.; Wang Q.; Ma X.; Ding Y. | Edgeld: Locally Distributed Deep Learning Inference On Edge Device Clusters | Proceedings - 2020 IEEE 22nd International Conference on High Performance Computing and Communications, IEEE 18th International Conference on Smart City and IEEE 6th International Conference on Data Science and Systems, HPCC-SmartCity-DSS 2020 (2020) |