Loading [MathJax]/extensions/tex2jax.js

Supplementary Material for "Charting the Benchmarking Landscape - A Survey of Benchmarks for Modern Memory Architectures"

Dataset: DatensatzDataset

Personen

  • Alexander Halbuer (Urheber*in)
  • Hamid Farzaneh (Urheber*in)
  • Sajad Karim (Urheber*in)
  • Birte Kristina Friesel (Urheber*in)
  • David Broneske (Urheber*in)
  • Sven Köhler (Urheber*in)
  • Muhammad Attahir Jibril (Urheber*in)
  • Benedict Herzog (Urheber*in)
  • Manuel Vögele (Urheber*in)

Externe Organisationen

  • Technische Universität Dresden
  • Otto-von-Guericke-Universität Magdeburg
  • Universität Osnabrück
  • Hasso-Plattner-Institut (HPI)
  • Technische Universität Ilmenau
  • Ruhr-Universität Bochum

Details

Datum der Bereitstellung27 März 2025
Herausgeber (Verlag)Zenodo

Beschreibung

This dataset is the result of our literature survey on modern memory benchmarks. It includes the csv-file that comprises the metadata of the found papers and our annotation. We furthermore ship analysis and chart generation scripts (in folder /bin). The corresponding article has the following abstract:

"Benchmarks play a crucial role in evaluating system components, comparing algorithmic advancements, and assessing software implementations. While well-established benchmark suites exist for various domains, modern memory technologies, such as high-bandwidth memory and near-memory computing, lack standardized benchmarking methodologies. Researchers often resort to custom benchmarks or adapt existing ones, making comparative analyses across different technologies challenging. Our survey provides a structured overview of benchmarks used in modern memory architectures, catering to both newcomers and experienced researchers. We categorize and analyze proposed and existing benchmarks, identify trends in their adoption, and highlight gaps in the benchmarking landscape. By offering insights into benchmarking methodologies and their evolution, our survey aims to guide researchers in selecting appropriate benchmarks for memory system evaluations, fostering consistency and comparability in future research. "