Smart City Gnosys
Smart city article details
| Title | Eris: An Online Auction For Scheduling Unbiased Distributed Learning Over Edge Networks |
|---|---|
| ID_Doc | 24315 |
| Authors | Pang J.; Han Z.; Zhou R.; Zhang R.; Lui J.C.S.; Chen H. |
| Year | 2024 |
| Published | IEEE Transactions on Mobile Computing, 23, 6 |
| DOI | http://dx.doi.org/10.1109/TMC.2023.3333368 |
| Abstract | The emergence of edge intelligence has made smart IoT services (e.g., video/audio surveillance, autonomous driving and smart city) a reality. To ensure the quality of service, edge service providers train unbiased models of distributed machine learning jobs over the local datasets collected by edge networks, and usually adopt the parameter server (PS) architecture. However, the training of unbiased distributed learning (UDL) depends on geo-distributed data and edge resources, bringing a new challenge for service providers: how to effectively schedule and price UDL jobs such that the long-term system utility (i.e., social welfare) can be maximized. In this paper, we propose an online auction-based scheduling algorithm Eris, which determines the data workload, the number and the placement of concurrent workers and PSs for each arriving UDL job, and dynamically prices limited edge resources based on current resource consumption. Eris applies a primal-dual framework which calls an efficient dual subroutine to schedule UDL jobs, achieving a good competitive ratio and pseudo-polynomial time complexity. To evaluate the effectiveness of Eris, we implement both a testbed and a large-scaled simulator. The results demonstrate that Eris outperforms and achieves up to 44% more social welfare compared to state-of-the-art algorithms in today's cloud system. © 2002-2012 IEEE. |
| Author Keywords | auction; Distributed machine learning; online scheduling |
Similar Articles
| Id | Similarity | Authors | Title | Published |
|---|---|---|---|---|
20985  | 0.904 | Zhou R.; Wang N.; Huang Y.; Pang J.; Chen H. | Dps: Dynamic Pricing And Scheduling For Distributed Machine Learning Jobs In Edge-Cloud Networks | IEEE Transactions on Mobile Computing, 22, 11 (2023) |
| 40078 | 0.897 | Han Z.; Zhou R.; Pang J.; Cao Y.; Tan H. | Online Scheduling Unbiased Distributed Learning Over Wireless Edge Networks | Proceedings of the International Conference on Parallel and Distributed Systems - ICPADS, 2021-December (2021) |
| 42904 | 0.865 | Wang N.; Zhou R.; Jiao L.; Zhang R.; Li B.; Li Z. | Preemptive Scheduling For Distributed Machine Learning Jobs In Edge-Cloud Networks | IEEE Journal on Selected Areas in Communications, 40, 8 (2022) |
| 23505 | 0.865 | Rey-Jouanchicot J.; Lorenzo Del Castillo J.A.; Zuckerman S.; Belmega E.V. | Energy-Efficient Online Resource Provisioning For Cloud-Edge Platforms Via Multi-Armed Bandits | Proceedings - Symposium on Computer Architecture and High Performance Computing, 2022-November (2022) |
| 1881 | 0.855 | Rasane A.; Tapale M. | A Game Theory-Based Reverse Vickrey Auction For Dynamic Pricing In Edge Computing | 3rd International Conference on Intelligent Data Communication Technologies and Internet of Things, IDCIoT 2025 (2025) |
| 5222 | 0.851 | Kumar D.; Baranwal G.; Vidyarthi D.P. | A Survey On Auction Based Approaches For Resource Allocation And Pricing In Emerging Edge Technologies | Journal of Grid Computing, 20, 1 (2022) |