Morsels: Explicit Virtual Memory Objects

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

  • Alexander Halbuer
  • Christian Dietrich
  • Florian Rommel
  • Daniel Lohmann

External Research Organisations

  • Hamburg University of Technology (TUHH)
View graph of relations

Details

Original languageEnglish
Title of host publicationDIMES '23
Subtitle of host publicationProceedings of the 1st Workshop on Disruptive Memory Systems
Pages52-59
Number of pages8
ISBN (electronic)9798400703003
Publication statusPublished - 23 Oct 2023
Event1st Workshop on Disruptive Memory Systems, DIMES 2023, co-located with the 29th ACM Symposium on Operating Systems Principles, SOSP 2023 - Koblenz, Germany
Duration: 23 Oct 202323 Oct 2023

Abstract

The tremendous growth of RAM capacity - now exceeding multiple terabytes - necessitates a reevaluation of traditional memory-management methods, which were developed when resources were scarce. Current virtual-memory subsystems handle address-space regions as sets of individual 4-KiB pages with demand paging and copy-on-write, resulting in significant management overhead. Although huge pages reduce the number of managed entities, they induce internal fragmentation and have a coarse copy granularity.To address these problems, we introduce Morsels, a novel virtual-memory-management paradigm that is purely based on hardware data structures and enables the efficient sharing of virtual-memory objects between processes and devices while being well suited for non-volatile memory. Our benchmarks show that Morsels reduce the mapping time for a 6.82-GiB machine-learning model by up to 99.8 percent compared to conventional memory mapping in Linux.

ASJC Scopus subject areas

Cite this

Morsels: Explicit Virtual Memory Objects. / Halbuer, Alexander; Dietrich, Christian; Rommel, Florian et al.
DIMES '23: Proceedings of the 1st Workshop on Disruptive Memory Systems. 2023. p. 52-59.

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Halbuer, A, Dietrich, C, Rommel, F & Lohmann, D 2023, Morsels: Explicit Virtual Memory Objects. in DIMES '23: Proceedings of the 1st Workshop on Disruptive Memory Systems. pp. 52-59, 1st Workshop on Disruptive Memory Systems, DIMES 2023, co-located with the 29th ACM Symposium on Operating Systems Principles, SOSP 2023, Koblenz, Germany, 23 Oct 2023. https://doi.org/10.1145/3609308.3625267
Halbuer, A., Dietrich, C., Rommel, F., & Lohmann, D. (2023). Morsels: Explicit Virtual Memory Objects. In DIMES '23: Proceedings of the 1st Workshop on Disruptive Memory Systems (pp. 52-59) https://doi.org/10.1145/3609308.3625267
Halbuer A, Dietrich C, Rommel F, Lohmann D. Morsels: Explicit Virtual Memory Objects. In DIMES '23: Proceedings of the 1st Workshop on Disruptive Memory Systems. 2023. p. 52-59 doi: 10.1145/3609308.3625267
Halbuer, Alexander ; Dietrich, Christian ; Rommel, Florian et al. / Morsels : Explicit Virtual Memory Objects. DIMES '23: Proceedings of the 1st Workshop on Disruptive Memory Systems. 2023. pp. 52-59
Download
@inproceedings{463c62fd2ca444928fe5c2227e6e6d3b,
title = "Morsels: Explicit Virtual Memory Objects",
abstract = "The tremendous growth of RAM capacity - now exceeding multiple terabytes - necessitates a reevaluation of traditional memory-management methods, which were developed when resources were scarce. Current virtual-memory subsystems handle address-space regions as sets of individual 4-KiB pages with demand paging and copy-on-write, resulting in significant management overhead. Although huge pages reduce the number of managed entities, they induce internal fragmentation and have a coarse copy granularity.To address these problems, we introduce Morsels, a novel virtual-memory-management paradigm that is purely based on hardware data structures and enables the efficient sharing of virtual-memory objects between processes and devices while being well suited for non-volatile memory. Our benchmarks show that Morsels reduce the mapping time for a 6.82-GiB machine-learning model by up to 99.8 percent compared to conventional memory mapping in Linux.",
author = "Alexander Halbuer and Christian Dietrich and Florian Rommel and Daniel Lohmann",
note = "Funding Information: We thank our reviewers for their valuable feedback. This work was funded by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) – 468988364, 501887536. ; 1st Workshop on Disruptive Memory Systems, DIMES 2023, co-located with the 29th ACM Symposium on Operating Systems Principles, SOSP 2023 ; Conference date: 23-10-2023 Through 23-10-2023",
year = "2023",
month = oct,
day = "23",
doi = "10.1145/3609308.3625267",
language = "English",
pages = "52--59",
booktitle = "DIMES '23",

}

Download

TY - GEN

T1 - Morsels

T2 - 1st Workshop on Disruptive Memory Systems, DIMES 2023, co-located with the 29th ACM Symposium on Operating Systems Principles, SOSP 2023

AU - Halbuer, Alexander

AU - Dietrich, Christian

AU - Rommel, Florian

AU - Lohmann, Daniel

N1 - Funding Information: We thank our reviewers for their valuable feedback. This work was funded by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) – 468988364, 501887536.

PY - 2023/10/23

Y1 - 2023/10/23

N2 - The tremendous growth of RAM capacity - now exceeding multiple terabytes - necessitates a reevaluation of traditional memory-management methods, which were developed when resources were scarce. Current virtual-memory subsystems handle address-space regions as sets of individual 4-KiB pages with demand paging and copy-on-write, resulting in significant management overhead. Although huge pages reduce the number of managed entities, they induce internal fragmentation and have a coarse copy granularity.To address these problems, we introduce Morsels, a novel virtual-memory-management paradigm that is purely based on hardware data structures and enables the efficient sharing of virtual-memory objects between processes and devices while being well suited for non-volatile memory. Our benchmarks show that Morsels reduce the mapping time for a 6.82-GiB machine-learning model by up to 99.8 percent compared to conventional memory mapping in Linux.

AB - The tremendous growth of RAM capacity - now exceeding multiple terabytes - necessitates a reevaluation of traditional memory-management methods, which were developed when resources were scarce. Current virtual-memory subsystems handle address-space regions as sets of individual 4-KiB pages with demand paging and copy-on-write, resulting in significant management overhead. Although huge pages reduce the number of managed entities, they induce internal fragmentation and have a coarse copy granularity.To address these problems, we introduce Morsels, a novel virtual-memory-management paradigm that is purely based on hardware data structures and enables the efficient sharing of virtual-memory objects between processes and devices while being well suited for non-volatile memory. Our benchmarks show that Morsels reduce the mapping time for a 6.82-GiB machine-learning model by up to 99.8 percent compared to conventional memory mapping in Linux.

UR - http://www.scopus.com/inward/record.url?scp=85176912779&partnerID=8YFLogxK

U2 - 10.1145/3609308.3625267

DO - 10.1145/3609308.3625267

M3 - Conference contribution

AN - SCOPUS:85176912779

SP - 52

EP - 59

BT - DIMES '23

Y2 - 23 October 2023 through 23 October 2023

ER -