AutoML in Heavily Constrained Applications

Publikation: Beitrag in FachzeitschriftArtikelForschungPeer-Review

Autoren

Externe Organisationen

  • Technische Universität Berlin
Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Seiten (von - bis)957–979
Seitenumfang23
FachzeitschriftVLDB Journal
Jahrgang33
Ausgabenummer4
Frühes Online-Datum17 Nov. 2023
PublikationsstatusVeröffentlicht - Juli 2024

Abstract

Optimizing a machine learning pipeline for a task at hand requires careful configuration of various hyperparameters, typically supported by an AutoML system that optimizes the hyperparameters for the given training dataset. Yet, depending on the AutoML system’s own second-order meta-configuration, the performance of the AutoML process can vary significantly. Current AutoML systems cannot automatically adapt their own configuration to a specific use case. Further, they cannot compile user-defined application constraints on the effectiveness and efficiency of the pipeline and its generation. In this paper, we propose Caml, which uses meta-learning to automatically adapt its own AutoML parameters, such as the search strategy, the validation strategy, and the search space, for a task at hand. The dynamic AutoML strategy of Caml takes user-defined constraints into account and obtains constraint-satisfying pipelines with high predictive performance.

ASJC Scopus Sachgebiete

Zitieren

AutoML in Heavily Constrained Applications. / Neutatz, Felix; Lindauer, Marius; Abedjan, Ziawasch.
in: VLDB Journal, Jahrgang 33, Nr. 4, 07.2024, S. 957–979.

Publikation: Beitrag in FachzeitschriftArtikelForschungPeer-Review

Neutatz F, Lindauer M, Abedjan Z. AutoML in Heavily Constrained Applications. VLDB Journal. 2024 Jul;33(4):957–979. Epub 2023 Nov 17. doi: 10.48550/arXiv.2306.16913, 10.1007/s00778-023-00820-1
Neutatz, Felix ; Lindauer, Marius ; Abedjan, Ziawasch. / AutoML in Heavily Constrained Applications. in: VLDB Journal. 2024 ; Jahrgang 33, Nr. 4. S. 957–979.
Download
@article{1760e392ded9445fb52078f7ce45a366,
title = "AutoML in Heavily Constrained Applications",
abstract = "Optimizing a machine learning pipeline for a task at hand requires careful configuration of various hyperparameters, typically supported by an AutoML system that optimizes the hyperparameters for the given training dataset. Yet, depending on the AutoML system{\textquoteright}s own second-order meta-configuration, the performance of the AutoML process can vary significantly. Current AutoML systems cannot automatically adapt their own configuration to a specific use case. Further, they cannot compile user-defined application constraints on the effectiveness and efficiency of the pipeline and its generation. In this paper, we propose Caml, which uses meta-learning to automatically adapt its own AutoML parameters, such as the search strategy, the validation strategy, and the search space, for a task at hand. The dynamic AutoML strategy of Caml takes user-defined constraints into account and obtains constraint-satisfying pipelines with high predictive performance.",
keywords = "AutoML, Constraints, Meta-Learning",
author = "Felix Neutatz and Marius Lindauer and Ziawasch Abedjan",
note = "Publisher Copyright: {\textcopyright} The Author(s) 2023.",
year = "2024",
month = jul,
doi = "10.48550/arXiv.2306.16913",
language = "English",
volume = "33",
pages = "957–979",
journal = "VLDB Journal",
issn = "1066-8888",
publisher = "Springer New York",
number = "4",

}

Download

TY - JOUR

T1 - AutoML in Heavily Constrained Applications

AU - Neutatz, Felix

AU - Lindauer, Marius

AU - Abedjan, Ziawasch

N1 - Publisher Copyright: © The Author(s) 2023.

PY - 2024/7

Y1 - 2024/7

N2 - Optimizing a machine learning pipeline for a task at hand requires careful configuration of various hyperparameters, typically supported by an AutoML system that optimizes the hyperparameters for the given training dataset. Yet, depending on the AutoML system’s own second-order meta-configuration, the performance of the AutoML process can vary significantly. Current AutoML systems cannot automatically adapt their own configuration to a specific use case. Further, they cannot compile user-defined application constraints on the effectiveness and efficiency of the pipeline and its generation. In this paper, we propose Caml, which uses meta-learning to automatically adapt its own AutoML parameters, such as the search strategy, the validation strategy, and the search space, for a task at hand. The dynamic AutoML strategy of Caml takes user-defined constraints into account and obtains constraint-satisfying pipelines with high predictive performance.

AB - Optimizing a machine learning pipeline for a task at hand requires careful configuration of various hyperparameters, typically supported by an AutoML system that optimizes the hyperparameters for the given training dataset. Yet, depending on the AutoML system’s own second-order meta-configuration, the performance of the AutoML process can vary significantly. Current AutoML systems cannot automatically adapt their own configuration to a specific use case. Further, they cannot compile user-defined application constraints on the effectiveness and efficiency of the pipeline and its generation. In this paper, we propose Caml, which uses meta-learning to automatically adapt its own AutoML parameters, such as the search strategy, the validation strategy, and the search space, for a task at hand. The dynamic AutoML strategy of Caml takes user-defined constraints into account and obtains constraint-satisfying pipelines with high predictive performance.

KW - AutoML

KW - Constraints

KW - Meta-Learning

UR - http://www.scopus.com/inward/record.url?scp=85176733476&partnerID=8YFLogxK

U2 - 10.48550/arXiv.2306.16913

DO - 10.48550/arXiv.2306.16913

M3 - Article

VL - 33

SP - 957

EP - 979

JO - VLDB Journal

JF - VLDB Journal

SN - 1066-8888

IS - 4

ER -

Von denselben Autoren