Enhancing virtual machine placement efficiency in cloud data centers: a hybrid approach using multi-objective reinforcement learning and clustering strategies

Research output: Contribution to journalArticleResearchpeer review

Authors

  • Arezoo Ghasemi
  • Abolfazl Toroghi Haghighat
  • Amin Keshavarzi

Research Organisations

External Research Organisations

  • Islamic Azad University
View graph of relations

Details

Original languageEnglish
Pages (from-to)2897-2922
Number of pages26
JournalComputing
Volume106
Issue number9
Early online date2 Jul 2024
Publication statusPublished - Sept 2024

Abstract

Deploying virtual machines poses a significant challenge for cloud data centers, requiring careful consideration of various objectives such as minimizing energy consumption, resource wastage, ensuring load balancing, and meeting service level agreements. While researchers have explored multi-objective methods to tackle virtual machine placement, evaluating potential solutions remains complex in such scenarios. In this paper, we introduce two novel multi-objective algorithms tailored to address this challenge. The VMPMFuzzyORL method employs reinforcement learning for virtual machine placement, with candidate solutions assessed using a fuzzy system. While practical, incorporating fuzzy systems introduces notable runtime overhead. To mitigate this, we propose MRRL, an alternative approach involving initial virtual machine clustering using the k-means algorithm, followed by optimized placement utilizing a customized reinforcement learning strategy with multiple reward signals. Extensive simulations highlight the significant advantages of these approaches over existing techniques, particularly energy efficiency, resource utilization, load balancing, and overall execution time.

Keywords

    Cloud computing, Clustering, Machine learning, Virtual machine placement, 68T20, 68T42, 68T05

ASJC Scopus subject areas

Sustainable Development Goals

Cite this

Enhancing virtual machine placement efficiency in cloud data centers: a hybrid approach using multi-objective reinforcement learning and clustering strategies. / Ghasemi, Arezoo; Toroghi Haghighat, Abolfazl; Keshavarzi, Amin.
In: Computing, Vol. 106, No. 9, 09.2024, p. 2897-2922.

Research output: Contribution to journalArticleResearchpeer review

Ghasemi A, Toroghi Haghighat A, Keshavarzi A. Enhancing virtual machine placement efficiency in cloud data centers: a hybrid approach using multi-objective reinforcement learning and clustering strategies. Computing. 2024 Sept;106(9):2897-2922. Epub 2024 Jul 2. doi: 10.1007/s00607-024-01311-z
Ghasemi, Arezoo ; Toroghi Haghighat, Abolfazl ; Keshavarzi, Amin. / Enhancing virtual machine placement efficiency in cloud data centers : a hybrid approach using multi-objective reinforcement learning and clustering strategies. In: Computing. 2024 ; Vol. 106, No. 9. pp. 2897-2922.
Download
@article{5c92afac52d04f2f9999fee4e8edeacf,
title = "Enhancing virtual machine placement efficiency in cloud data centers: a hybrid approach using multi-objective reinforcement learning and clustering strategies",
abstract = "Deploying virtual machines poses a significant challenge for cloud data centers, requiring careful consideration of various objectives such as minimizing energy consumption, resource wastage, ensuring load balancing, and meeting service level agreements. While researchers have explored multi-objective methods to tackle virtual machine placement, evaluating potential solutions remains complex in such scenarios. In this paper, we introduce two novel multi-objective algorithms tailored to address this challenge. The VMPMFuzzyORL method employs reinforcement learning for virtual machine placement, with candidate solutions assessed using a fuzzy system. While practical, incorporating fuzzy systems introduces notable runtime overhead. To mitigate this, we propose MRRL, an alternative approach involving initial virtual machine clustering using the k-means algorithm, followed by optimized placement utilizing a customized reinforcement learning strategy with multiple reward signals. Extensive simulations highlight the significant advantages of these approaches over existing techniques, particularly energy efficiency, resource utilization, load balancing, and overall execution time.",
keywords = "Cloud computing, Clustering, Machine learning, Virtual machine placement, 68T20, 68T42, 68T05",
author = "Arezoo Ghasemi and {Toroghi Haghighat}, Abolfazl and Amin Keshavarzi",
note = "Publisher Copyright: {\textcopyright} The Author(s), under exclusive licence to Springer-Verlag GmbH Austria, part of Springer Nature 2024.",
year = "2024",
month = sep,
doi = "10.1007/s00607-024-01311-z",
language = "English",
volume = "106",
pages = "2897--2922",
journal = "Computing",
issn = "0010-485X",
publisher = "Springer-Verlag Wien",
number = "9",

}

Download

TY - JOUR

T1 - Enhancing virtual machine placement efficiency in cloud data centers

T2 - a hybrid approach using multi-objective reinforcement learning and clustering strategies

AU - Ghasemi, Arezoo

AU - Toroghi Haghighat, Abolfazl

AU - Keshavarzi, Amin

N1 - Publisher Copyright: © The Author(s), under exclusive licence to Springer-Verlag GmbH Austria, part of Springer Nature 2024.

PY - 2024/9

Y1 - 2024/9

N2 - Deploying virtual machines poses a significant challenge for cloud data centers, requiring careful consideration of various objectives such as minimizing energy consumption, resource wastage, ensuring load balancing, and meeting service level agreements. While researchers have explored multi-objective methods to tackle virtual machine placement, evaluating potential solutions remains complex in such scenarios. In this paper, we introduce two novel multi-objective algorithms tailored to address this challenge. The VMPMFuzzyORL method employs reinforcement learning for virtual machine placement, with candidate solutions assessed using a fuzzy system. While practical, incorporating fuzzy systems introduces notable runtime overhead. To mitigate this, we propose MRRL, an alternative approach involving initial virtual machine clustering using the k-means algorithm, followed by optimized placement utilizing a customized reinforcement learning strategy with multiple reward signals. Extensive simulations highlight the significant advantages of these approaches over existing techniques, particularly energy efficiency, resource utilization, load balancing, and overall execution time.

AB - Deploying virtual machines poses a significant challenge for cloud data centers, requiring careful consideration of various objectives such as minimizing energy consumption, resource wastage, ensuring load balancing, and meeting service level agreements. While researchers have explored multi-objective methods to tackle virtual machine placement, evaluating potential solutions remains complex in such scenarios. In this paper, we introduce two novel multi-objective algorithms tailored to address this challenge. The VMPMFuzzyORL method employs reinforcement learning for virtual machine placement, with candidate solutions assessed using a fuzzy system. While practical, incorporating fuzzy systems introduces notable runtime overhead. To mitigate this, we propose MRRL, an alternative approach involving initial virtual machine clustering using the k-means algorithm, followed by optimized placement utilizing a customized reinforcement learning strategy with multiple reward signals. Extensive simulations highlight the significant advantages of these approaches over existing techniques, particularly energy efficiency, resource utilization, load balancing, and overall execution time.

KW - Cloud computing

KW - Clustering

KW - Machine learning

KW - Virtual machine placement

KW - 68T20

KW - 68T42

KW - 68T05

UR - http://www.scopus.com/inward/record.url?scp=85197251866&partnerID=8YFLogxK

U2 - 10.1007/s00607-024-01311-z

DO - 10.1007/s00607-024-01311-z

M3 - Article

AN - SCOPUS:85197251866

VL - 106

SP - 2897

EP - 2922

JO - Computing

JF - Computing

SN - 0010-485X

IS - 9

ER -