Smart City Gnosys
Smart city article details
| Title | Reinforcement Learning Based Heterogeneous Resource Provisioning For Cloud Web Applications |
|---|---|
| ID_Doc | 44873 |
| Authors | Fang Y.; Cai Z. |
| Year | 2020 |
| Published | Proceedings - 2020 IEEE 22nd International Conference on High Performance Computing and Communications, IEEE 18th International Conference on Smart City and IEEE 6th International Conference on Data Science and Systems, HPCC-SmartCity-DSS 2020 |
| DOI | http://dx.doi.org/10.1109/HPCC-SmartCity-DSS50907.2020.00026 |
| Abstract | Cloud computing enables enterprises to deploy Web applications on elastically rented Virtual Machines (VMs). In order to minimize VM rental costs while fulfilling Service Level Agreements (SLAs), it is crucial to design effective VM provisioning algorithms. Queueing and control theories based methods are widely used in existing works. However, complex nonlinear system characteristics restrict these methods from getting well performance and most of them are tailored for homogeneous resources. In this paper, a deep reinforcement learning method is proposed for provisioning heterogeneous multi-Type VMs which takes advantage of the deep-learning-network's nonlinear modeling ability, incremental-VM-capacity-based action space definition and Integer Linear Programming based mapping from the incremental capacity to the multi-Type VM renting plan. Experimental results demonstrate that our approach achieves the fastest convergence speed and highest total rewards. © 2020 IEEE. |
| Author Keywords | Cloud computing; Reinforcement learning; Resource provisioning; Spot VM; Web application |
Similar Articles
| Id | Similarity | Authors | Title | Published |
|---|---|---|---|---|
49037  | 0.899 | Ran L.; Shi X.; Shang M. | Slas-Aware Online Task Scheduling Based On Deep Reinforcement Learning Method In Cloud Environment | Proceedings - 21st IEEE International Conference on High Performance Computing and Communications, 17th IEEE International Conference on Smart City and 5th IEEE International Conference on Data Science and Systems, HPCC/SmartCity/DSS 2019 (2019) |
| 4043 | 0.852 | Long S.; Li Z.; Xing Y.; Tian S.; Li D.; Yu R. | A Reinforcement Learning-Based Virtual Machine Placement Strategy In Cloud Data Centers | Proceedings - 2020 IEEE 22nd International Conference on High Performance Computing and Communications, IEEE 18th International Conference on Smart City and IEEE 6th International Conference on Data Science and Systems, HPCC-SmartCity-DSS 2020 (2020) |
| 46071 | 0.851 | Cui X. | Resource Allocation In Iot Edge Computing Networks Based On Reinforcement Learning | Advances in Transdisciplinary Engineering, 70 (2025) |