Correlation-Aware Heuristic Search for Intelligent Virtual Machine Provisioning in Cloud Systems

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

  • Chuan Luo
  • Bo Qiao
  • Wenqian Xing
  • Xin Chen
  • Pu Zhao
  • Chao Du
  • Randolph Yao
  • Hongyu Zhang
  • Wei Wu
  • Shaowei Cai
  • Bing He
  • Saravanakumar Rajmohan
  • Qingwei Lin

Research Organisations

External Research Organisations

  • University of Newcastle
  • CAS - Institute of Software
  • Microsoft Corporation
  • Microsoft Research
View graph of relations

Details

Original languageEnglish
Title of host publication35th AAAI Conference on Artificial Intelligence, AAAI 2021
Pages12363-12372
Number of pages10
ISBN (electronic)9781713835974
Publication statusPublished - 18 May 2021
Event35th AAAI Conference on Artificial Intelligence, AAAI 2021 - Virtual, Online
Duration: 2 Feb 20219 Feb 2021

Abstract

The optimization of resource is crucial for the operation of public cloud systems such as Microsoft Azure, as well as servers dedicated to the workloads of large customers such as Microsoft 365. Those optimization tasks often need to take unknown parameters into consideration and can be formulated as Prediction+Optimization problems. This paper proposes a new Prediction+Optimization method named Correlation-Aware Heuristic Search (CAHS) that is capable of accounting for the uncertainty in unknown parameters and delivering effective solutions to difficult optimization problems. We apply this method to solving the predictive virtual machine (VM) provisioning (PreVMP) problem, where the VM provisioning plans are optimized based on the predicted demands of different VM types, to ensure rapid provisions upon customers' requests and to pursue high resource utilization. Unlike the current state-of-the-art PreVMP approaches that assume independence among the demands for different VM types, CAHS incorporates demand correlation when conducting prediction and optimization in a novel and effective way. Our experiments on two public benchmarks and one industrial benchmark demonstrate that CAHS can achieve better performance than its nine state-of-the-art competitors. CAHS has been successfully deployed in Microsoft Azure and significantly improved its performance. The main ideas of CAHS have also been leveraged to improve the efficiency and the reliability of the cloud services provided by Microsoft 365.

ASJC Scopus subject areas

Cite this

Correlation-Aware Heuristic Search for Intelligent Virtual Machine Provisioning in Cloud Systems. / Luo, Chuan; Qiao, Bo; Xing, Wenqian et al.
35th AAAI Conference on Artificial Intelligence, AAAI 2021. 2021. p. 12363-12372.

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Luo, C, Qiao, B, Xing, W, Chen, X, Zhao, P, Du, C, Yao, R, Zhang, H, Wu, W, Cai, S, He, B, Rajmohan, S & Lin, Q 2021, Correlation-Aware Heuristic Search for Intelligent Virtual Machine Provisioning in Cloud Systems. in 35th AAAI Conference on Artificial Intelligence, AAAI 2021. pp. 12363-12372, 35th AAAI Conference on Artificial Intelligence, AAAI 2021, Virtual, Online, 2 Feb 2021. https://doi.org/10.1609/aaai.v35i14.17467
Luo, C., Qiao, B., Xing, W., Chen, X., Zhao, P., Du, C., Yao, R., Zhang, H., Wu, W., Cai, S., He, B., Rajmohan, S., & Lin, Q. (2021). Correlation-Aware Heuristic Search for Intelligent Virtual Machine Provisioning in Cloud Systems. In 35th AAAI Conference on Artificial Intelligence, AAAI 2021 (pp. 12363-12372) https://doi.org/10.1609/aaai.v35i14.17467
Luo C, Qiao B, Xing W, Chen X, Zhao P, Du C et al. Correlation-Aware Heuristic Search for Intelligent Virtual Machine Provisioning in Cloud Systems. In 35th AAAI Conference on Artificial Intelligence, AAAI 2021. 2021. p. 12363-12372 doi: 10.1609/aaai.v35i14.17467
Luo, Chuan ; Qiao, Bo ; Xing, Wenqian et al. / Correlation-Aware Heuristic Search for Intelligent Virtual Machine Provisioning in Cloud Systems. 35th AAAI Conference on Artificial Intelligence, AAAI 2021. 2021. pp. 12363-12372
Download
@inproceedings{37201ca6632448cdb8bebd9ff3b2aa8a,
title = "Correlation-Aware Heuristic Search for Intelligent Virtual Machine Provisioning in Cloud Systems",
abstract = "The optimization of resource is crucial for the operation of public cloud systems such as Microsoft Azure, as well as servers dedicated to the workloads of large customers such as Microsoft 365. Those optimization tasks often need to take unknown parameters into consideration and can be formulated as Prediction+Optimization problems. This paper proposes a new Prediction+Optimization method named Correlation-Aware Heuristic Search (CAHS) that is capable of accounting for the uncertainty in unknown parameters and delivering effective solutions to difficult optimization problems. We apply this method to solving the predictive virtual machine (VM) provisioning (PreVMP) problem, where the VM provisioning plans are optimized based on the predicted demands of different VM types, to ensure rapid provisions upon customers' requests and to pursue high resource utilization. Unlike the current state-of-the-art PreVMP approaches that assume independence among the demands for different VM types, CAHS incorporates demand correlation when conducting prediction and optimization in a novel and effective way. Our experiments on two public benchmarks and one industrial benchmark demonstrate that CAHS can achieve better performance than its nine state-of-the-art competitors. CAHS has been successfully deployed in Microsoft Azure and significantly improved its performance. The main ideas of CAHS have also been leveraged to improve the efficiency and the reliability of the cloud services provided by Microsoft 365.",
author = "Chuan Luo and Bo Qiao and Wenqian Xing and Xin Chen and Pu Zhao and Chao Du and Randolph Yao and Hongyu Zhang and Wei Wu and Shaowei Cai and Bing He and Saravanakumar Rajmohan and Qingwei Lin",
year = "2021",
month = may,
day = "18",
doi = "10.1609/aaai.v35i14.17467",
language = "English",
pages = "12363--12372",
booktitle = "35th AAAI Conference on Artificial Intelligence, AAAI 2021",
note = "35th AAAI Conference on Artificial Intelligence, AAAI 2021 ; Conference date: 02-02-2021 Through 09-02-2021",

}

Download

TY - GEN

T1 - Correlation-Aware Heuristic Search for Intelligent Virtual Machine Provisioning in Cloud Systems

AU - Luo, Chuan

AU - Qiao, Bo

AU - Xing, Wenqian

AU - Chen, Xin

AU - Zhao, Pu

AU - Du, Chao

AU - Yao, Randolph

AU - Zhang, Hongyu

AU - Wu, Wei

AU - Cai, Shaowei

AU - He, Bing

AU - Rajmohan, Saravanakumar

AU - Lin, Qingwei

PY - 2021/5/18

Y1 - 2021/5/18

N2 - The optimization of resource is crucial for the operation of public cloud systems such as Microsoft Azure, as well as servers dedicated to the workloads of large customers such as Microsoft 365. Those optimization tasks often need to take unknown parameters into consideration and can be formulated as Prediction+Optimization problems. This paper proposes a new Prediction+Optimization method named Correlation-Aware Heuristic Search (CAHS) that is capable of accounting for the uncertainty in unknown parameters and delivering effective solutions to difficult optimization problems. We apply this method to solving the predictive virtual machine (VM) provisioning (PreVMP) problem, where the VM provisioning plans are optimized based on the predicted demands of different VM types, to ensure rapid provisions upon customers' requests and to pursue high resource utilization. Unlike the current state-of-the-art PreVMP approaches that assume independence among the demands for different VM types, CAHS incorporates demand correlation when conducting prediction and optimization in a novel and effective way. Our experiments on two public benchmarks and one industrial benchmark demonstrate that CAHS can achieve better performance than its nine state-of-the-art competitors. CAHS has been successfully deployed in Microsoft Azure and significantly improved its performance. The main ideas of CAHS have also been leveraged to improve the efficiency and the reliability of the cloud services provided by Microsoft 365.

AB - The optimization of resource is crucial for the operation of public cloud systems such as Microsoft Azure, as well as servers dedicated to the workloads of large customers such as Microsoft 365. Those optimization tasks often need to take unknown parameters into consideration and can be formulated as Prediction+Optimization problems. This paper proposes a new Prediction+Optimization method named Correlation-Aware Heuristic Search (CAHS) that is capable of accounting for the uncertainty in unknown parameters and delivering effective solutions to difficult optimization problems. We apply this method to solving the predictive virtual machine (VM) provisioning (PreVMP) problem, where the VM provisioning plans are optimized based on the predicted demands of different VM types, to ensure rapid provisions upon customers' requests and to pursue high resource utilization. Unlike the current state-of-the-art PreVMP approaches that assume independence among the demands for different VM types, CAHS incorporates demand correlation when conducting prediction and optimization in a novel and effective way. Our experiments on two public benchmarks and one industrial benchmark demonstrate that CAHS can achieve better performance than its nine state-of-the-art competitors. CAHS has been successfully deployed in Microsoft Azure and significantly improved its performance. The main ideas of CAHS have also been leveraged to improve the efficiency and the reliability of the cloud services provided by Microsoft 365.

UR - http://www.scopus.com/inward/record.url?scp=85130092725&partnerID=8YFLogxK

U2 - 10.1609/aaai.v35i14.17467

DO - 10.1609/aaai.v35i14.17467

M3 - Conference contribution

AN - SCOPUS:85130092725

SP - 12363

EP - 12372

BT - 35th AAAI Conference on Artificial Intelligence, AAAI 2021

T2 - 35th AAAI Conference on Artificial Intelligence, AAAI 2021

Y2 - 2 February 2021 through 9 February 2021

ER -