BOAH: A Tool Suite for Multi-Fidelity Bayesian Optimization & Analysis of Hyperparameters

Research output: Working paper/PreprintPreprint

Authors

  • Marius Lindauer
  • Katharina Eggensperger
  • Matthias Feurer
  • André Biedenkapp
  • Joshua Marben
  • Philipp Müller
  • Frank Hutter

External Research Organisations

  • University of Freiburg
  • Robert Bosch GmbH
View graph of relations

Details

Original languageEnglish
Publication statusE-pub ahead of print - 16 Aug 2019
Externally publishedYes

Abstract

Hyperparameter optimization and neural architecture search can become prohibitively expensive for regular black-box Bayesian optimization because the training and evaluation of a single model can easily take several hours. To overcome this, we introduce a comprehensive tool suite for effective multi-fidelity Bayesian optimization and the analysis of its runs. The suite, written in Python, provides a simple way to specify complex design spaces, a robust and efficient combination of Bayesian optimization and HyperBand, and a comprehensive analysis of the optimization process and its outcomes.

Keywords

    cs.LG, cs.AI, stat.ML

Cite this

BOAH: A Tool Suite for Multi-Fidelity Bayesian Optimization & Analysis of Hyperparameters. / Lindauer, Marius; Eggensperger, Katharina; Feurer, Matthias et al.
2019.

Research output: Working paper/PreprintPreprint

Lindauer, M, Eggensperger, K, Feurer, M, Biedenkapp, A, Marben, J, Müller, P & Hutter, F 2019 'BOAH: A Tool Suite for Multi-Fidelity Bayesian Optimization & Analysis of Hyperparameters'. <https://arxiv.org/pdf/1908.06756>
Lindauer, M., Eggensperger, K., Feurer, M., Biedenkapp, A., Marben, J., Müller, P., & Hutter, F. (2019). BOAH: A Tool Suite for Multi-Fidelity Bayesian Optimization & Analysis of Hyperparameters. Advance online publication. https://arxiv.org/pdf/1908.06756
Lindauer M, Eggensperger K, Feurer M, Biedenkapp A, Marben J, Müller P et al. BOAH: A Tool Suite for Multi-Fidelity Bayesian Optimization & Analysis of Hyperparameters. 2019 Aug 16. Epub 2019 Aug 16.
Download
@techreport{9334dbb0c6dd4036b74cfab14bbda633,
title = "BOAH: A Tool Suite for Multi-Fidelity Bayesian Optimization & Analysis of Hyperparameters",
abstract = " Hyperparameter optimization and neural architecture search can become prohibitively expensive for regular black-box Bayesian optimization because the training and evaluation of a single model can easily take several hours. To overcome this, we introduce a comprehensive tool suite for effective multi-fidelity Bayesian optimization and the analysis of its runs. The suite, written in Python, provides a simple way to specify complex design spaces, a robust and efficient combination of Bayesian optimization and HyperBand, and a comprehensive analysis of the optimization process and its outcomes. ",
keywords = "cs.LG, cs.AI, stat.ML",
author = "Marius Lindauer and Katharina Eggensperger and Matthias Feurer and Andr{\'e} Biedenkapp and Joshua Marben and Philipp M{\"u}ller and Frank Hutter",
year = "2019",
month = aug,
day = "16",
language = "English",
type = "WorkingPaper",

}

Download

TY - UNPB

T1 - BOAH: A Tool Suite for Multi-Fidelity Bayesian Optimization & Analysis of Hyperparameters

AU - Lindauer, Marius

AU - Eggensperger, Katharina

AU - Feurer, Matthias

AU - Biedenkapp, André

AU - Marben, Joshua

AU - Müller, Philipp

AU - Hutter, Frank

PY - 2019/8/16

Y1 - 2019/8/16

N2 - Hyperparameter optimization and neural architecture search can become prohibitively expensive for regular black-box Bayesian optimization because the training and evaluation of a single model can easily take several hours. To overcome this, we introduce a comprehensive tool suite for effective multi-fidelity Bayesian optimization and the analysis of its runs. The suite, written in Python, provides a simple way to specify complex design spaces, a robust and efficient combination of Bayesian optimization and HyperBand, and a comprehensive analysis of the optimization process and its outcomes.

AB - Hyperparameter optimization and neural architecture search can become prohibitively expensive for regular black-box Bayesian optimization because the training and evaluation of a single model can easily take several hours. To overcome this, we introduce a comprehensive tool suite for effective multi-fidelity Bayesian optimization and the analysis of its runs. The suite, written in Python, provides a simple way to specify complex design spaces, a robust and efficient combination of Bayesian optimization and HyperBand, and a comprehensive analysis of the optimization process and its outcomes.

KW - cs.LG

KW - cs.AI

KW - stat.ML

M3 - Preprint

BT - BOAH: A Tool Suite for Multi-Fidelity Bayesian Optimization & Analysis of Hyperparameters

ER -

By the same author(s)