Towards Green Automated Machine Learning: Status Quo and Future Directions

Research output: Contribution to journalArticleResearchpeer review

Authors

External Research Organisations

  • Paderborn University
  • Universidad de la Sabana
  • Ludwig-Maximilians-Universität München (LMU)
  • Munich Center for Machine Learning (MCML)
View graph of relations

Details

Original languageEnglish
Pages (from-to)427-457
Number of pages31
JournalJournal of Artificial Intelligence Research
Volume77
Publication statusPublished - 2023
Externally publishedYes

Abstract

Automated machine learning (AutoML) strives for the automatic configuration of machine learning algorithms and their composition into an overall (software) solution - a machine learning pipeline - tailored to the learning task (dataset) at hand. Over the last decade, AutoML has developed into an independent research field with hundreds of contributions. At the same time, AutoML is being criticized for its high resource consumption as many approaches rely on the (costly) evaluation of many machine learning pipelines, as well as the expensive large-scale experiments across many datasets and approaches. In the spirit of recent work on Green AI, this paper proposes Green AutoML, a paradigm to make the whole AutoML process more environmentally friendly. Therefore, we first elaborate on how to quantify the environmental footprint of an AutoML tool. Afterward, different strategies on how to design and benchmark an AutoML tool w.r.t. their "greenness", i.e., sustainability, are summarized. Finally, we elaborate on how to be transparent about the environmental footprint and what kind of research incentives could direct the community in a more sustainable AutoML research direction. As part of this, we propose a sustainability checklist to be attached to every AutoML paper featuring all core aspects of Green AutoML.

Keywords

    cs.LG

ASJC Scopus subject areas

Sustainable Development Goals

Cite this

Towards Green Automated Machine Learning: Status Quo and Future Directions. / Tornede, Tanja; Tornede, Alexander; Hanselle, Jonas et al.
In: Journal of Artificial Intelligence Research, Vol. 77, 2023, p. 427-457.

Research output: Contribution to journalArticleResearchpeer review

Tornede T, Tornede A, Hanselle J, Mohr F, Wever M, Hüllermeier E. Towards Green Automated Machine Learning: Status Quo and Future Directions. Journal of Artificial Intelligence Research. 2023;77:427-457. doi: 10.1613/jair.1.14340
Download
@article{09a561c732224bcf9e6159418f825ea9,
title = "Towards Green Automated Machine Learning: Status Quo and Future Directions",
abstract = "Automated machine learning (AutoML) strives for the automatic configuration of machine learning algorithms and their composition into an overall (software) solution - a machine learning pipeline - tailored to the learning task (dataset) at hand. Over the last decade, AutoML has developed into an independent research field with hundreds of contributions. At the same time, AutoML is being criticized for its high resource consumption as many approaches rely on the (costly) evaluation of many machine learning pipelines, as well as the expensive large-scale experiments across many datasets and approaches. In the spirit of recent work on Green AI, this paper proposes Green AutoML, a paradigm to make the whole AutoML process more environmentally friendly. Therefore, we first elaborate on how to quantify the environmental footprint of an AutoML tool. Afterward, different strategies on how to design and benchmark an AutoML tool w.r.t. their {"}greenness{"}, i.e., sustainability, are summarized. Finally, we elaborate on how to be transparent about the environmental footprint and what kind of research incentives could direct the community in a more sustainable AutoML research direction. As part of this, we propose a sustainability checklist to be attached to every AutoML paper featuring all core aspects of Green AutoML.",
keywords = "cs.LG",
author = "Tanja Tornede and Alexander Tornede and Jonas Hanselle and Felix Mohr and Marcel Wever and Eyke H{\"u}llermeier",
note = "Publisher Copyright: {\textcopyright} 2023 The Authors.",
year = "2023",
doi = "10.1613/jair.1.14340",
language = "English",
volume = "77",
pages = "427--457",
journal = "Journal of Artificial Intelligence Research",
issn = "1076-9757",
publisher = "Morgan Kaufmann Publishers, Inc.",

}

Download

TY - JOUR

T1 - Towards Green Automated Machine Learning

T2 - Status Quo and Future Directions

AU - Tornede, Tanja

AU - Tornede, Alexander

AU - Hanselle, Jonas

AU - Mohr, Felix

AU - Wever, Marcel

AU - Hüllermeier, Eyke

N1 - Publisher Copyright: © 2023 The Authors.

PY - 2023

Y1 - 2023

N2 - Automated machine learning (AutoML) strives for the automatic configuration of machine learning algorithms and their composition into an overall (software) solution - a machine learning pipeline - tailored to the learning task (dataset) at hand. Over the last decade, AutoML has developed into an independent research field with hundreds of contributions. At the same time, AutoML is being criticized for its high resource consumption as many approaches rely on the (costly) evaluation of many machine learning pipelines, as well as the expensive large-scale experiments across many datasets and approaches. In the spirit of recent work on Green AI, this paper proposes Green AutoML, a paradigm to make the whole AutoML process more environmentally friendly. Therefore, we first elaborate on how to quantify the environmental footprint of an AutoML tool. Afterward, different strategies on how to design and benchmark an AutoML tool w.r.t. their "greenness", i.e., sustainability, are summarized. Finally, we elaborate on how to be transparent about the environmental footprint and what kind of research incentives could direct the community in a more sustainable AutoML research direction. As part of this, we propose a sustainability checklist to be attached to every AutoML paper featuring all core aspects of Green AutoML.

AB - Automated machine learning (AutoML) strives for the automatic configuration of machine learning algorithms and their composition into an overall (software) solution - a machine learning pipeline - tailored to the learning task (dataset) at hand. Over the last decade, AutoML has developed into an independent research field with hundreds of contributions. At the same time, AutoML is being criticized for its high resource consumption as many approaches rely on the (costly) evaluation of many machine learning pipelines, as well as the expensive large-scale experiments across many datasets and approaches. In the spirit of recent work on Green AI, this paper proposes Green AutoML, a paradigm to make the whole AutoML process more environmentally friendly. Therefore, we first elaborate on how to quantify the environmental footprint of an AutoML tool. Afterward, different strategies on how to design and benchmark an AutoML tool w.r.t. their "greenness", i.e., sustainability, are summarized. Finally, we elaborate on how to be transparent about the environmental footprint and what kind of research incentives could direct the community in a more sustainable AutoML research direction. As part of this, we propose a sustainability checklist to be attached to every AutoML paper featuring all core aspects of Green AutoML.

KW - cs.LG

UR - http://www.scopus.com/inward/record.url?scp=85162139256&partnerID=8YFLogxK

U2 - 10.1613/jair.1.14340

DO - 10.1613/jair.1.14340

M3 - Article

VL - 77

SP - 427

EP - 457

JO - Journal of Artificial Intelligence Research

JF - Journal of Artificial Intelligence Research

SN - 1076-9757

ER -

By the same author(s)