The New Costs of Physical Memory Fragmentation

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

  • Alexander Halbuer
  • Illia Ostapyshyn
  • Lukas Steiner
  • Lars Wrenger
  • Matthias Jung
  • Christian Dietrich
  • Daniel Lohmann

External Research Organisations

  • University of Kaiserslautern-Landau (RPTU)
  • Julius Maximilian University of Würzburg
  • Technische Universität Braunschweig
View graph of relations

Details

Original languageEnglish
Title of host publicationDIMES 2024 - Proceedings of the 2nd Workshop on Disruptive Memory Systems, Part of
Subtitle of host publicationSOSP 2024
Pages33-40
Number of pages8
ISBN (electronic)9798400713033
Publication statusPublished - 3 Nov 2024
Event2nd Workshop on Disruptive Memory Systems, DIMES 2024, co-located with the 30th ACM Symposium on Operating Systems Principles, SOSP 2024 - Austin, United States
Duration: 3 Nov 20243 Nov 2024

Publication series

NameProceedings of the 2nd Workshop on Disruptive Memory Systems

Abstract

External fragmentation is becoming a serious problem again after paging temporarily solved it with its one-size-fits-all 4 KiB approach. The increasing adoption of mixed base, huge, and giant page sizes, DRAM energy-saving techniques, and memory disaggregation, necessitates a memory management system capable of handling larger entities in the range of multiple megabytes up to several gigabytes. A case study in Linux reveals that the operating system reasonably minimizes fragmentation up to huge page size, but falls short when it comes to larger granularities. Therefore, it requires much effort to entirely free a memory block for powering down or returning it to the memory provider; in some cases, this may be entirely impossible due to immovable kernel memory. Additionally, our analysis highlights that the page cache is responsible for a large share of memory usage, as it keeps all cached pages until memory pressure rises. This behavior originates from the outdated assumption that utilizing memory comes at no cost and, therefore, requires further investigation.

Keywords

    Distributed Memory, DRAM, Energy Savings, Fragmentation, Linux, Memory Management, Operating Systems, Physical Memory

ASJC Scopus subject areas

Cite this

The New Costs of Physical Memory Fragmentation. / Halbuer, Alexander; Ostapyshyn, Illia; Steiner, Lukas et al.
DIMES 2024 - Proceedings of the 2nd Workshop on Disruptive Memory Systems, Part of: SOSP 2024. 2024. p. 33-40 (Proceedings of the 2nd Workshop on Disruptive Memory Systems).

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Halbuer, A, Ostapyshyn, I, Steiner, L, Wrenger, L, Jung, M, Dietrich, C & Lohmann, D 2024, The New Costs of Physical Memory Fragmentation. in DIMES 2024 - Proceedings of the 2nd Workshop on Disruptive Memory Systems, Part of: SOSP 2024. Proceedings of the 2nd Workshop on Disruptive Memory Systems, pp. 33-40, 2nd Workshop on Disruptive Memory Systems, DIMES 2024, co-located with the 30th ACM Symposium on Operating Systems Principles, SOSP 2024, Austin, Texas, United States, 3 Nov 2024. https://doi.org/10.1145/3698783.3699378
Halbuer, A., Ostapyshyn, I., Steiner, L., Wrenger, L., Jung, M., Dietrich, C., & Lohmann, D. (2024). The New Costs of Physical Memory Fragmentation. In DIMES 2024 - Proceedings of the 2nd Workshop on Disruptive Memory Systems, Part of: SOSP 2024 (pp. 33-40). (Proceedings of the 2nd Workshop on Disruptive Memory Systems). https://doi.org/10.1145/3698783.3699378
Halbuer A, Ostapyshyn I, Steiner L, Wrenger L, Jung M, Dietrich C et al. The New Costs of Physical Memory Fragmentation. In DIMES 2024 - Proceedings of the 2nd Workshop on Disruptive Memory Systems, Part of: SOSP 2024. 2024. p. 33-40. (Proceedings of the 2nd Workshop on Disruptive Memory Systems). doi: 10.1145/3698783.3699378
Halbuer, Alexander ; Ostapyshyn, Illia ; Steiner, Lukas et al. / The New Costs of Physical Memory Fragmentation. DIMES 2024 - Proceedings of the 2nd Workshop on Disruptive Memory Systems, Part of: SOSP 2024. 2024. pp. 33-40 (Proceedings of the 2nd Workshop on Disruptive Memory Systems).
Download
@inproceedings{437e50d48c9c468387fa40d58b1b4d46,
title = "The New Costs of Physical Memory Fragmentation",
abstract = "External fragmentation is becoming a serious problem again after paging temporarily solved it with its one-size-fits-all 4 KiB approach. The increasing adoption of mixed base, huge, and giant page sizes, DRAM energy-saving techniques, and memory disaggregation, necessitates a memory management system capable of handling larger entities in the range of multiple megabytes up to several gigabytes. A case study in Linux reveals that the operating system reasonably minimizes fragmentation up to huge page size, but falls short when it comes to larger granularities. Therefore, it requires much effort to entirely free a memory block for powering down or returning it to the memory provider; in some cases, this may be entirely impossible due to immovable kernel memory. Additionally, our analysis highlights that the page cache is responsible for a large share of memory usage, as it keeps all cached pages until memory pressure rises. This behavior originates from the outdated assumption that utilizing memory comes at no cost and, therefore, requires further investigation.",
keywords = "Distributed Memory, DRAM, Energy Savings, Fragmentation, Linux, Memory Management, Operating Systems, Physical Memory",
author = "Alexander Halbuer and Illia Ostapyshyn and Lukas Steiner and Lars Wrenger and Matthias Jung and Christian Dietrich and Daniel Lohmann",
note = "Publisher Copyright: {\textcopyright} 2024 Owner/Author.; 2nd Workshop on Disruptive Memory Systems, DIMES 2024, co-located with the 30th ACM Symposium on Operating Systems Principles, SOSP 2024 ; Conference date: 03-11-2024 Through 03-11-2024",
year = "2024",
month = nov,
day = "3",
doi = "10.1145/3698783.3699378",
language = "English",
series = "Proceedings of the 2nd Workshop on Disruptive Memory Systems",
pages = "33--40",
booktitle = "DIMES 2024 - Proceedings of the 2nd Workshop on Disruptive Memory Systems, Part of",

}

Download

TY - GEN

T1 - The New Costs of Physical Memory Fragmentation

AU - Halbuer, Alexander

AU - Ostapyshyn, Illia

AU - Steiner, Lukas

AU - Wrenger, Lars

AU - Jung, Matthias

AU - Dietrich, Christian

AU - Lohmann, Daniel

N1 - Publisher Copyright: © 2024 Owner/Author.

PY - 2024/11/3

Y1 - 2024/11/3

N2 - External fragmentation is becoming a serious problem again after paging temporarily solved it with its one-size-fits-all 4 KiB approach. The increasing adoption of mixed base, huge, and giant page sizes, DRAM energy-saving techniques, and memory disaggregation, necessitates a memory management system capable of handling larger entities in the range of multiple megabytes up to several gigabytes. A case study in Linux reveals that the operating system reasonably minimizes fragmentation up to huge page size, but falls short when it comes to larger granularities. Therefore, it requires much effort to entirely free a memory block for powering down or returning it to the memory provider; in some cases, this may be entirely impossible due to immovable kernel memory. Additionally, our analysis highlights that the page cache is responsible for a large share of memory usage, as it keeps all cached pages until memory pressure rises. This behavior originates from the outdated assumption that utilizing memory comes at no cost and, therefore, requires further investigation.

AB - External fragmentation is becoming a serious problem again after paging temporarily solved it with its one-size-fits-all 4 KiB approach. The increasing adoption of mixed base, huge, and giant page sizes, DRAM energy-saving techniques, and memory disaggregation, necessitates a memory management system capable of handling larger entities in the range of multiple megabytes up to several gigabytes. A case study in Linux reveals that the operating system reasonably minimizes fragmentation up to huge page size, but falls short when it comes to larger granularities. Therefore, it requires much effort to entirely free a memory block for powering down or returning it to the memory provider; in some cases, this may be entirely impossible due to immovable kernel memory. Additionally, our analysis highlights that the page cache is responsible for a large share of memory usage, as it keeps all cached pages until memory pressure rises. This behavior originates from the outdated assumption that utilizing memory comes at no cost and, therefore, requires further investigation.

KW - Distributed Memory

KW - DRAM

KW - Energy Savings

KW - Fragmentation

KW - Linux

KW - Memory Management

KW - Operating Systems

KW - Physical Memory

UR - http://www.scopus.com/inward/record.url?scp=85212517195&partnerID=8YFLogxK

U2 - 10.1145/3698783.3699378

DO - 10.1145/3698783.3699378

M3 - Conference contribution

AN - SCOPUS:85212517195

T3 - Proceedings of the 2nd Workshop on Disruptive Memory Systems

SP - 33

EP - 40

BT - DIMES 2024 - Proceedings of the 2nd Workshop on Disruptive Memory Systems, Part of

T2 - 2nd Workshop on Disruptive Memory Systems, DIMES 2024, co-located with the 30th ACM Symposium on Operating Systems Principles, SOSP 2024

Y2 - 3 November 2024 through 3 November 2024

ER -