Squirrel: A Switching Hyperparameter Optimizer

Research output: Working paper/PreprintPreprint

Authors

  • Noor Awad
  • Gresa Shala
  • Difan Deng
  • Neeratyoy Mallik
  • Matthias Feurer
  • Katharina Eggensperger
  • André Biedenkapp
  • Diederick Vermetten
  • Hao Wang
  • Carola Doerr
  • Marius Lindauer
  • Frank Hutter

External Research Organisations

  • University of Freiburg
  • Leiden University
  • Sorbonne Université
  • Bosch Center for Artificial Intelligence (BCAI)
View graph of relations

Details

Original languageEnglish
Number of pages3
Publication statusE-pub ahead of print - 16 Dec 2020

Abstract

In this short note, we describe our submission to the NeurIPS 2020 BBO challenge. Motivated by the fact that different optimizers work well on different problems, our approach switches between different optimizers. Since the team names on the competition's leaderboard were randomly generated "alliteration nicknames", consisting of an adjective and an animal with the same initial letter, we called our approach the Switching Squirrel, or here, short, Squirrel.

Keywords

    cs.LG, cs.NE, stat.ML

Cite this

Squirrel: A Switching Hyperparameter Optimizer. / Awad, Noor; Shala, Gresa; Deng, Difan et al.
2020.

Research output: Working paper/PreprintPreprint

Awad, N, Shala, G, Deng, D, Mallik, N, Feurer, M, Eggensperger, K, Biedenkapp, A, Vermetten, D, Wang, H, Doerr, C, Lindauer, M & Hutter, F 2020 'Squirrel: A Switching Hyperparameter Optimizer'. <https://arxiv.org/abs/2012.08180>
Awad, N., Shala, G., Deng, D., Mallik, N., Feurer, M., Eggensperger, K., Biedenkapp, A., Vermetten, D., Wang, H., Doerr, C., Lindauer, M., & Hutter, F. (2020). Squirrel: A Switching Hyperparameter Optimizer. Advance online publication. https://arxiv.org/abs/2012.08180
Awad N, Shala G, Deng D, Mallik N, Feurer M, Eggensperger K et al. Squirrel: A Switching Hyperparameter Optimizer. 2020 Dec 16. Epub 2020 Dec 16.
Awad, Noor ; Shala, Gresa ; Deng, Difan et al. / Squirrel : A Switching Hyperparameter Optimizer. 2020.
Download
@techreport{76d30f176ba642b99c9caca956c1e775,
title = "Squirrel: A Switching Hyperparameter Optimizer",
abstract = " In this short note, we describe our submission to the NeurIPS 2020 BBO challenge. Motivated by the fact that different optimizers work well on different problems, our approach switches between different optimizers. Since the team names on the competition's leaderboard were randomly generated {"}alliteration nicknames{"}, consisting of an adjective and an animal with the same initial letter, we called our approach the Switching Squirrel, or here, short, Squirrel. ",
keywords = "cs.LG, cs.NE, stat.ML",
author = "Noor Awad and Gresa Shala and Difan Deng and Neeratyoy Mallik and Matthias Feurer and Katharina Eggensperger and Andr{\'e} Biedenkapp and Diederick Vermetten and Hao Wang and Carola Doerr and Marius Lindauer and Frank Hutter",
year = "2020",
month = dec,
day = "16",
language = "English",
type = "WorkingPaper",

}

Download

TY - UNPB

T1 - Squirrel

T2 - A Switching Hyperparameter Optimizer

AU - Awad, Noor

AU - Shala, Gresa

AU - Deng, Difan

AU - Mallik, Neeratyoy

AU - Feurer, Matthias

AU - Eggensperger, Katharina

AU - Biedenkapp, André

AU - Vermetten, Diederick

AU - Wang, Hao

AU - Doerr, Carola

AU - Lindauer, Marius

AU - Hutter, Frank

PY - 2020/12/16

Y1 - 2020/12/16

N2 - In this short note, we describe our submission to the NeurIPS 2020 BBO challenge. Motivated by the fact that different optimizers work well on different problems, our approach switches between different optimizers. Since the team names on the competition's leaderboard were randomly generated "alliteration nicknames", consisting of an adjective and an animal with the same initial letter, we called our approach the Switching Squirrel, or here, short, Squirrel.

AB - In this short note, we describe our submission to the NeurIPS 2020 BBO challenge. Motivated by the fact that different optimizers work well on different problems, our approach switches between different optimizers. Since the team names on the competition's leaderboard were randomly generated "alliteration nicknames", consisting of an adjective and an animal with the same initial letter, we called our approach the Switching Squirrel, or here, short, Squirrel.

KW - cs.LG

KW - cs.NE

KW - stat.ML

M3 - Preprint

BT - Squirrel

ER -

By the same author(s)