The New Costs of Physical Memory Fragmentation

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Autoren

  • Alexander Halbuer
  • Illia Ostapyshyn
  • Lukas Steiner
  • Lars Wrenger
  • Matthias Jung
  • Christian Dietrich
  • Daniel Lohmann

Externe Organisationen

  • Rheinland-Pfälzische Technische Universität Kaiserslautern-Landau (RPTU)
  • Julius-Maximilians-Universität Würzburg
  • Technische Universität Braunschweig
Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Titel des SammelwerksDIMES 2024 - Proceedings of the 2nd Workshop on Disruptive Memory Systems, Part of
UntertitelSOSP 2024
Seiten33-40
Seitenumfang8
ISBN (elektronisch)9798400713033
PublikationsstatusVeröffentlicht - 3 Nov. 2024
Veranstaltung2nd Workshop on Disruptive Memory Systems, DIMES 2024, co-located with the 30th ACM Symposium on Operating Systems Principles, SOSP 2024 - Austin, USA / Vereinigte Staaten
Dauer: 3 Nov. 2024 → …

Publikationsreihe

NameDIMES 2024 - Proceedings of the 2nd Workshop on Disruptive Memory Systems, Part of: SOSP 2024

Abstract

External fragmentation is becoming a serious problem again after paging temporarily solved it with its one-size-fits-all 4 KiB approach. The increasing adoption of mixed base, huge, and giant page sizes, DRAM energy-saving techniques, and memory disaggregation, necessitates a memory management system capable of handling larger entities in the range of multiple megabytes up to several gigabytes. A case study in Linux reveals that the operating system reasonably minimizes fragmentation up to huge page size, but falls short when it comes to larger granularities. Therefore, it requires much effort to entirely free a memory block for powering down or returning it to the memory provider; in some cases, this may be entirely impossible due to immovable kernel memory. Additionally, our analysis highlights that the page cache is responsible for a large share of memory usage, as it keeps all cached pages until memory pressure rises. This behavior originates from the outdated assumption that utilizing memory comes at no cost and, therefore, requires further investigation.

ASJC Scopus Sachgebiete

Zitieren

The New Costs of Physical Memory Fragmentation. / Halbuer, Alexander; Ostapyshyn, Illia; Steiner, Lukas et al.
DIMES 2024 - Proceedings of the 2nd Workshop on Disruptive Memory Systems, Part of: SOSP 2024. 2024. S. 33-40 (DIMES 2024 - Proceedings of the 2nd Workshop on Disruptive Memory Systems, Part of: SOSP 2024).

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Halbuer, A, Ostapyshyn, I, Steiner, L, Wrenger, L, Jung, M, Dietrich, C & Lohmann, D 2024, The New Costs of Physical Memory Fragmentation. in DIMES 2024 - Proceedings of the 2nd Workshop on Disruptive Memory Systems, Part of: SOSP 2024. DIMES 2024 - Proceedings of the 2nd Workshop on Disruptive Memory Systems, Part of: SOSP 2024, S. 33-40, 2nd Workshop on Disruptive Memory Systems, DIMES 2024, co-located with the 30th ACM Symposium on Operating Systems Principles, SOSP 2024, Austin, USA / Vereinigte Staaten, 3 Nov. 2024. https://doi.org/10.1145/3698783.3699378
Halbuer, A., Ostapyshyn, I., Steiner, L., Wrenger, L., Jung, M., Dietrich, C., & Lohmann, D. (2024). The New Costs of Physical Memory Fragmentation. In DIMES 2024 - Proceedings of the 2nd Workshop on Disruptive Memory Systems, Part of: SOSP 2024 (S. 33-40). (DIMES 2024 - Proceedings of the 2nd Workshop on Disruptive Memory Systems, Part of: SOSP 2024). https://doi.org/10.1145/3698783.3699378
Halbuer A, Ostapyshyn I, Steiner L, Wrenger L, Jung M, Dietrich C et al. The New Costs of Physical Memory Fragmentation. in DIMES 2024 - Proceedings of the 2nd Workshop on Disruptive Memory Systems, Part of: SOSP 2024. 2024. S. 33-40. (DIMES 2024 - Proceedings of the 2nd Workshop on Disruptive Memory Systems, Part of: SOSP 2024). doi: 10.1145/3698783.3699378
Halbuer, Alexander ; Ostapyshyn, Illia ; Steiner, Lukas et al. / The New Costs of Physical Memory Fragmentation. DIMES 2024 - Proceedings of the 2nd Workshop on Disruptive Memory Systems, Part of: SOSP 2024. 2024. S. 33-40 (DIMES 2024 - Proceedings of the 2nd Workshop on Disruptive Memory Systems, Part of: SOSP 2024).
Download
@inproceedings{437e50d48c9c468387fa40d58b1b4d46,
title = "The New Costs of Physical Memory Fragmentation",
abstract = "External fragmentation is becoming a serious problem again after paging temporarily solved it with its one-size-fits-all 4 KiB approach. The increasing adoption of mixed base, huge, and giant page sizes, DRAM energy-saving techniques, and memory disaggregation, necessitates a memory management system capable of handling larger entities in the range of multiple megabytes up to several gigabytes. A case study in Linux reveals that the operating system reasonably minimizes fragmentation up to huge page size, but falls short when it comes to larger granularities. Therefore, it requires much effort to entirely free a memory block for powering down or returning it to the memory provider; in some cases, this may be entirely impossible due to immovable kernel memory. Additionally, our analysis highlights that the page cache is responsible for a large share of memory usage, as it keeps all cached pages until memory pressure rises. This behavior originates from the outdated assumption that utilizing memory comes at no cost and, therefore, requires further investigation.",
keywords = "Distributed Memory, DRAM, Energy Savings, Fragmentation, Linux, Memory Management, Operating Systems, Physical Memory",
author = "Alexander Halbuer and Illia Ostapyshyn and Lukas Steiner and Lars Wrenger and Matthias Jung and Christian Dietrich and Daniel Lohmann",
note = "Publisher Copyright: {\textcopyright} 2024 Owner/Author.; 2nd Workshop on Disruptive Memory Systems, DIMES 2024, co-located with the 30th ACM Symposium on Operating Systems Principles, SOSP 2024 ; Conference date: 03-11-2024",
year = "2024",
month = nov,
day = "3",
doi = "10.1145/3698783.3699378",
language = "English",
series = "DIMES 2024 - Proceedings of the 2nd Workshop on Disruptive Memory Systems, Part of: SOSP 2024",
pages = "33--40",
booktitle = "DIMES 2024 - Proceedings of the 2nd Workshop on Disruptive Memory Systems, Part of",

}

Download

TY - GEN

T1 - The New Costs of Physical Memory Fragmentation

AU - Halbuer, Alexander

AU - Ostapyshyn, Illia

AU - Steiner, Lukas

AU - Wrenger, Lars

AU - Jung, Matthias

AU - Dietrich, Christian

AU - Lohmann, Daniel

N1 - Publisher Copyright: © 2024 Owner/Author.

PY - 2024/11/3

Y1 - 2024/11/3

N2 - External fragmentation is becoming a serious problem again after paging temporarily solved it with its one-size-fits-all 4 KiB approach. The increasing adoption of mixed base, huge, and giant page sizes, DRAM energy-saving techniques, and memory disaggregation, necessitates a memory management system capable of handling larger entities in the range of multiple megabytes up to several gigabytes. A case study in Linux reveals that the operating system reasonably minimizes fragmentation up to huge page size, but falls short when it comes to larger granularities. Therefore, it requires much effort to entirely free a memory block for powering down or returning it to the memory provider; in some cases, this may be entirely impossible due to immovable kernel memory. Additionally, our analysis highlights that the page cache is responsible for a large share of memory usage, as it keeps all cached pages until memory pressure rises. This behavior originates from the outdated assumption that utilizing memory comes at no cost and, therefore, requires further investigation.

AB - External fragmentation is becoming a serious problem again after paging temporarily solved it with its one-size-fits-all 4 KiB approach. The increasing adoption of mixed base, huge, and giant page sizes, DRAM energy-saving techniques, and memory disaggregation, necessitates a memory management system capable of handling larger entities in the range of multiple megabytes up to several gigabytes. A case study in Linux reveals that the operating system reasonably minimizes fragmentation up to huge page size, but falls short when it comes to larger granularities. Therefore, it requires much effort to entirely free a memory block for powering down or returning it to the memory provider; in some cases, this may be entirely impossible due to immovable kernel memory. Additionally, our analysis highlights that the page cache is responsible for a large share of memory usage, as it keeps all cached pages until memory pressure rises. This behavior originates from the outdated assumption that utilizing memory comes at no cost and, therefore, requires further investigation.

KW - Distributed Memory

KW - DRAM

KW - Energy Savings

KW - Fragmentation

KW - Linux

KW - Memory Management

KW - Operating Systems

KW - Physical Memory

UR - http://www.scopus.com/inward/record.url?scp=85212517195&partnerID=8YFLogxK

U2 - 10.1145/3698783.3699378

DO - 10.1145/3698783.3699378

M3 - Conference contribution

AN - SCOPUS:85212517195

T3 - DIMES 2024 - Proceedings of the 2nd Workshop on Disruptive Memory Systems, Part of: SOSP 2024

SP - 33

EP - 40

BT - DIMES 2024 - Proceedings of the 2nd Workshop on Disruptive Memory Systems, Part of

T2 - 2nd Workshop on Disruptive Memory Systems, DIMES 2024, co-located with the 30th ACM Symposium on Operating Systems Principles, SOSP 2024

Y2 - 3 November 2024

ER -