Smart City Gnosys

Smart city article details

Title	Dps: Dynamic Pricing And Scheduling For Distributed Machine Learning Jobs In Edge-Cloud Networks
ID_Doc	20985
Authors	Zhou R.; Wang N.; Huang Y.; Pang J.; Chen H.
Year	2023
Published	IEEE Transactions on Mobile Computing, 22, 11
DOI	http://dx.doi.org/10.1109/TMC.2022.3195765
Abstract	5G and Internet of Things stimulate smart applications of edge computing, such as autonomous driving and smart city. As edge computing power increases, more and more machine learning (ML) jobs will be trained in the edge-cloud network, adopting the parameter server (PS) architecture. Due to the distinct features of the edge (low-latency and the scarcity of resources), the cloud (high delay and rich computing capacity) and ML jobs (frequent communication between workers and PSs and unfixed runtime), existing cloud job pricing and scheduling algorithms are not applicable. Therefore, how to price, deploy and schedule ML jobs in the edge-cloud network becomes a challenging problem. To solve it, we propose an auction-based online framework DPS. DPS consists of three major parts: job admission control, price function design and scheduling orchestrator. DPS dynamically prices workers and PSs based on historical job information and real-time system status, and decides whether to accept the job according to the deployment cost. DPS then deploys and schedules accepted ML jobs to pursue the maximum social welfare. Through theoretical analysis, we prove that DPS can achieve a good competition ratio and truthfulness in polynomial time. Large-scale simulations and testbed experiments show that DPS can improve social welfare by at least 95%95%, compared with benchmark algorithms in today's cloud system. © 2002-2012 IEEE.
Author Keywords	Distributed machine learning; edge-cloud networks; online pricing; online scheduling; parameter server architecture

Similar Articles

Id	Similarity	Authors	Title	Published
42904	0.914	Wang N.; Zhou R.; Jiao L.; Zhang R.; Li B.; Li Z.	Preemptive Scheduling For Distributed Machine Learning Jobs In Edge-Cloud Networks	IEEE Journal on Selected Areas in Communications, 40, 8 (2022)
24315	0.904	Pang J.; Han Z.; Zhou R.; Zhang R.; Lui J.C.S.; Chen H.	Eris: An Online Auction For Scheduling Unbiased Distributed Learning Over Edge Networks	IEEE Transactions on Mobile Computing, 23, 6 (2024)
7415	0.87	Moghaddasi K.; Rajabi S.; Gharehchopogh F.S.; Ghaffari A.	An Advanced Deep Reinforcement Learning Algorithm For Three-Layer D2D-Edge-Cloud Computing Architecture For Efficient Task Offloading In The Internet Of Things	Sustainable Computing: Informatics and Systems, 43 (2024)
57704	0.868	Zhu K.; Zhang Z.; Sun F.	Toward Intelligent Cooperation At The Edge: Improving The Qos Of Workflow Scheduling With The Competitive Cooperation Of Edge Servers	Wireless Networks, 30, 6 (2024)
23505	0.867	Rey-Jouanchicot J.; Lorenzo Del Castillo J.A.; Zuckerman S.; Belmega E.V.	Energy-Efficient Online Resource Provisioning For Cloud-Edge Platforms Via Multi-Armed Bandits	Proceedings - Symposium on Computer Architecture and High Performance Computing, 2022-November (2022)
34376	0.867	Wang H.; Chen X.; Xu H.; Liu J.; Huang L.	Joint Job Offloading And Resource Allocation For Distributed Deep Learning In Edge Computing	Proceedings - 21st IEEE International Conference on High Performance Computing and Communications, 17th IEEE International Conference on Smart City and 5th IEEE International Conference on Data Science and Systems, HPCC/SmartCity/DSS 2019 (2019)
43009	0.864	Tang Z.; Zhang F.; Zhou X.; Jia W.; Zhao W.	Pricing Model For Dynamic Resource Overbooking In Edge Computing	IEEE Transactions on Cloud Computing, 11, 2 (2023)
1881	0.864	Rasane A.; Tapale M.	A Game Theory-Based Reverse Vickrey Auction For Dynamic Pricing In Edge Computing	3rd International Conference on Intelligent Data Communication Technologies and Internet of Things, IDCIoT 2025 (2025)
18096	0.862	Qadeer A.; Lee M.J.	Deep-Deterministic Policy Gradient Based Multi-Resource Allocation In Edge-Cloud System: A Distributed Approach	IEEE Access, 11 (2023)
5222	0.861	Kumar D.; Baranwal G.; Vidyarthi D.P.	A Survey On Auction Based Approaches For Resource Allocation And Pricing In Emerging Edge Technologies	Journal of Grid Computing, 20, 1 (2022)