An RL-Based Model for Optimized Kubernetes Scheduling

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Autoren

  • John Rothman
  • Javad Chamanara

Organisationseinheiten

Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Titel des Sammelwerks2023 IEEE 31st International Conference on Network Protocols
UntertitelICNP
Herausgeber (Verlag)IEEE Computer Society
Seitenumfang6
ISBN (elektronisch)9798350303223
ISBN (Print)979-8-3503-0323-0
PublikationsstatusVeröffentlicht - 2023
Veranstaltung31st IEEE International Conference on Network Protocols, ICNP 2023 - Reykjavik, Island
Dauer: 10 Okt. 202313 Okt. 2023

Publikationsreihe

NameProceedings - International Conference on Network Protocols, ICNP
ISSN (Print)1092-1648

Abstract

In this paper, we present RLKube, a Reinforcement Learning (RL)-based custom Kubernetes (K8s) scheduler plugin for optimized task scheduling. RLKube objectives are maximizing resource utilization and Pod throughput as well as improving energy efficiency in a K8s cluster. We used Double Deep Q-Network (DDQN) with Prioritized Experience Replay (PER) and utilized different reward functions to train the RL agent. Also, we have developed corresponding policies for each objective. We have evaluated the effectiveness of RLKube using various datasets simulating a diverse set of realistic load patterns. The results show that RLKube outperforms the default K8s scheduling policies in terms of throughput and energy usage, highlighting its potential for Improving task scheduling in K8s clusters.

ASJC Scopus Sachgebiete

Ziele für nachhaltige Entwicklung

Zitieren

An RL-Based Model for Optimized Kubernetes Scheduling. / Rothman, John; Chamanara, Javad.
2023 IEEE 31st International Conference on Network Protocols: ICNP. IEEE Computer Society, 2023. (Proceedings - International Conference on Network Protocols, ICNP).

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Rothman, J & Chamanara, J 2023, An RL-Based Model for Optimized Kubernetes Scheduling. in 2023 IEEE 31st International Conference on Network Protocols: ICNP. Proceedings - International Conference on Network Protocols, ICNP, IEEE Computer Society, 31st IEEE International Conference on Network Protocols, ICNP 2023, Reykjavik, Island, 10 Okt. 2023. https://doi.org/10.1109/ICNP59255.2023.10355623
Rothman, J., & Chamanara, J. (2023). An RL-Based Model for Optimized Kubernetes Scheduling. In 2023 IEEE 31st International Conference on Network Protocols: ICNP (Proceedings - International Conference on Network Protocols, ICNP). IEEE Computer Society. https://doi.org/10.1109/ICNP59255.2023.10355623
Rothman J, Chamanara J. An RL-Based Model for Optimized Kubernetes Scheduling. in 2023 IEEE 31st International Conference on Network Protocols: ICNP. IEEE Computer Society. 2023. (Proceedings - International Conference on Network Protocols, ICNP). doi: 10.1109/ICNP59255.2023.10355623
Rothman, John ; Chamanara, Javad. / An RL-Based Model for Optimized Kubernetes Scheduling. 2023 IEEE 31st International Conference on Network Protocols: ICNP. IEEE Computer Society, 2023. (Proceedings - International Conference on Network Protocols, ICNP).
Download
@inproceedings{7ca48a820db54966bfc280440c704ea3,
title = "An RL-Based Model for Optimized Kubernetes Scheduling",
abstract = "In this paper, we present RLKube, a Reinforcement Learning (RL)-based custom Kubernetes (K8s) scheduler plugin for optimized task scheduling. RLKube objectives are maximizing resource utilization and Pod throughput as well as improving energy efficiency in a K8s cluster. We used Double Deep Q-Network (DDQN) with Prioritized Experience Replay (PER) and utilized different reward functions to train the RL agent. Also, we have developed corresponding policies for each objective. We have evaluated the effectiveness of RLKube using various datasets simulating a diverse set of realistic load patterns. The results show that RLKube outperforms the default K8s scheduling policies in terms of throughput and energy usage, highlighting its potential for Improving task scheduling in K8s clusters.",
keywords = "Energy Consumption, Kubernetes, Optimization, Scheduling",
author = "John Rothman and Javad Chamanara",
year = "2023",
doi = "10.1109/ICNP59255.2023.10355623",
language = "English",
isbn = "979-8-3503-0323-0",
series = "Proceedings - International Conference on Network Protocols, ICNP",
publisher = "IEEE Computer Society",
booktitle = "2023 IEEE 31st International Conference on Network Protocols",
address = "United States",
note = "31st IEEE International Conference on Network Protocols, ICNP 2023 ; Conference date: 10-10-2023 Through 13-10-2023",

}

Download

TY - GEN

T1 - An RL-Based Model for Optimized Kubernetes Scheduling

AU - Rothman, John

AU - Chamanara, Javad

PY - 2023

Y1 - 2023

N2 - In this paper, we present RLKube, a Reinforcement Learning (RL)-based custom Kubernetes (K8s) scheduler plugin for optimized task scheduling. RLKube objectives are maximizing resource utilization and Pod throughput as well as improving energy efficiency in a K8s cluster. We used Double Deep Q-Network (DDQN) with Prioritized Experience Replay (PER) and utilized different reward functions to train the RL agent. Also, we have developed corresponding policies for each objective. We have evaluated the effectiveness of RLKube using various datasets simulating a diverse set of realistic load patterns. The results show that RLKube outperforms the default K8s scheduling policies in terms of throughput and energy usage, highlighting its potential for Improving task scheduling in K8s clusters.

AB - In this paper, we present RLKube, a Reinforcement Learning (RL)-based custom Kubernetes (K8s) scheduler plugin for optimized task scheduling. RLKube objectives are maximizing resource utilization and Pod throughput as well as improving energy efficiency in a K8s cluster. We used Double Deep Q-Network (DDQN) with Prioritized Experience Replay (PER) and utilized different reward functions to train the RL agent. Also, we have developed corresponding policies for each objective. We have evaluated the effectiveness of RLKube using various datasets simulating a diverse set of realistic load patterns. The results show that RLKube outperforms the default K8s scheduling policies in terms of throughput and energy usage, highlighting its potential for Improving task scheduling in K8s clusters.

KW - Energy Consumption

KW - Kubernetes

KW - Optimization

KW - Scheduling

UR - http://www.scopus.com/inward/record.url?scp=85182517484&partnerID=8YFLogxK

U2 - 10.1109/ICNP59255.2023.10355623

DO - 10.1109/ICNP59255.2023.10355623

M3 - Conference contribution

AN - SCOPUS:85182517484

SN - 979-8-3503-0323-0

T3 - Proceedings - International Conference on Network Protocols, ICNP

BT - 2023 IEEE 31st International Conference on Network Protocols

PB - IEEE Computer Society

T2 - 31st IEEE International Conference on Network Protocols, ICNP 2023

Y2 - 10 October 2023 through 13 October 2023

ER -