Hybrid ranking and regression for algorithm selection

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Autorschaft

  • Jonas Hanselle
  • Alexander Tornede
  • Marcel Wever
  • Eyke Hüllermeier

Externe Organisationen

  • Universität Paderborn
  • Heinz Nixdorf Institut (HNI)
Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Titel des SammelwerksKI 2020
UntertitelAdvances in Artificial Intelligence - 43rd German Conference on AI, Proceedings
Herausgeber/-innenUte Schmid, Diedrich Wolter, Franziska Klügl
Herausgeber (Verlag)Springer Science and Business Media Deutschland GmbH
Seiten59-72
Seitenumfang14
ISBN (Print)9783030582845
PublikationsstatusVeröffentlicht - 2020
Extern publiziertJa
Veranstaltung43rd German Conference on Artificial Intelligence, KI 2020 - Bamberg, Deutschland
Dauer: 21 Sept. 202025 Sept. 2020

Publikationsreihe

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Band12325 LNAI
ISSN (Print)0302-9743
ISSN (elektronisch)1611-3349

Abstract

Algorithm selection (AS) is defined as the task of automatically selecting the most suitable algorithm from a set of candidate algorithms for a specific instance of an algorithmic problem class. While suitability may refer to different criteria, runtime is of specific practical relevance. Leveraging empirical runtime information as training data, the AS problem is commonly tackled by fitting a regression function, which can then be used to estimate the candidate algorithms’ runtimes for new problem instances. In this paper, we develop a new approach to algorithm selection that combines regression with ranking, also known as learning to rank, a problem that has recently been studied in the realm of preference learning. Since only the ranking of the algorithms is eventually needed for the purpose of selection, the precise numerical estimation of runtimes appears to be a dispensable and unnecessarily difficult problem. However, discarding the numerical runtime information completely seems to be a bad idea, as we hide potentially useful information about the algorithms’ performance margins from the learner. Extensive experimental studies confirm the potential of our hybrid approach, showing that it often performs better than pure regression and pure ranking methods.

ASJC Scopus Sachgebiete

Zitieren

Hybrid ranking and regression for algorithm selection. / Hanselle, Jonas; Tornede, Alexander; Wever, Marcel et al.
KI 2020: Advances in Artificial Intelligence - 43rd German Conference on AI, Proceedings. Hrsg. / Ute Schmid; Diedrich Wolter; Franziska Klügl. Springer Science and Business Media Deutschland GmbH, 2020. S. 59-72 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Band 12325 LNAI).

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Hanselle, J, Tornede, A, Wever, M & Hüllermeier, E 2020, Hybrid ranking and regression for algorithm selection. in U Schmid, D Wolter & F Klügl (Hrsg.), KI 2020: Advances in Artificial Intelligence - 43rd German Conference on AI, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Bd. 12325 LNAI, Springer Science and Business Media Deutschland GmbH, S. 59-72, 43rd German Conference on Artificial Intelligence, KI 2020, Bamberg, Deutschland, 21 Sept. 2020. https://doi.org/10.1007/978-3-030-58285-2_5
Hanselle, J., Tornede, A., Wever, M., & Hüllermeier, E. (2020). Hybrid ranking and regression for algorithm selection. In U. Schmid, D. Wolter, & F. Klügl (Hrsg.), KI 2020: Advances in Artificial Intelligence - 43rd German Conference on AI, Proceedings (S. 59-72). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Band 12325 LNAI). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-030-58285-2_5
Hanselle J, Tornede A, Wever M, Hüllermeier E. Hybrid ranking and regression for algorithm selection. in Schmid U, Wolter D, Klügl F, Hrsg., KI 2020: Advances in Artificial Intelligence - 43rd German Conference on AI, Proceedings. Springer Science and Business Media Deutschland GmbH. 2020. S. 59-72. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-030-58285-2_5
Hanselle, Jonas ; Tornede, Alexander ; Wever, Marcel et al. / Hybrid ranking and regression for algorithm selection. KI 2020: Advances in Artificial Intelligence - 43rd German Conference on AI, Proceedings. Hrsg. / Ute Schmid ; Diedrich Wolter ; Franziska Klügl. Springer Science and Business Media Deutschland GmbH, 2020. S. 59-72 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
Download
@inproceedings{d5f73e1c7d9f48e5b9954ac783450957,
title = "Hybrid ranking and regression for algorithm selection",
abstract = "Algorithm selection (AS) is defined as the task of automatically selecting the most suitable algorithm from a set of candidate algorithms for a specific instance of an algorithmic problem class. While suitability may refer to different criteria, runtime is of specific practical relevance. Leveraging empirical runtime information as training data, the AS problem is commonly tackled by fitting a regression function, which can then be used to estimate the candidate algorithms{\textquoteright} runtimes for new problem instances. In this paper, we develop a new approach to algorithm selection that combines regression with ranking, also known as learning to rank, a problem that has recently been studied in the realm of preference learning. Since only the ranking of the algorithms is eventually needed for the purpose of selection, the precise numerical estimation of runtimes appears to be a dispensable and unnecessarily difficult problem. However, discarding the numerical runtime information completely seems to be a bad idea, as we hide potentially useful information about the algorithms{\textquoteright} performance margins from the learner. Extensive experimental studies confirm the potential of our hybrid approach, showing that it often performs better than pure regression and pure ranking methods.",
keywords = "Algorithm selection, Combined ranking and regression, Hybrid loss optimization",
author = "Jonas Hanselle and Alexander Tornede and Marcel Wever and Eyke H{\"u}llermeier",
note = "Publisher Copyright: {\textcopyright} Springer Nature Switzerland AG 2020.; 43rd German Conference on Artificial Intelligence, KI 2020 ; Conference date: 21-09-2020 Through 25-09-2020",
year = "2020",
doi = "10.1007/978-3-030-58285-2_5",
language = "English",
isbn = "9783030582845",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Science and Business Media Deutschland GmbH",
pages = "59--72",
editor = "Ute Schmid and Diedrich Wolter and Franziska Kl{\"u}gl",
booktitle = "KI 2020",
address = "Germany",

}

Download

TY - GEN

T1 - Hybrid ranking and regression for algorithm selection

AU - Hanselle, Jonas

AU - Tornede, Alexander

AU - Wever, Marcel

AU - Hüllermeier, Eyke

N1 - Publisher Copyright: © Springer Nature Switzerland AG 2020.

PY - 2020

Y1 - 2020

N2 - Algorithm selection (AS) is defined as the task of automatically selecting the most suitable algorithm from a set of candidate algorithms for a specific instance of an algorithmic problem class. While suitability may refer to different criteria, runtime is of specific practical relevance. Leveraging empirical runtime information as training data, the AS problem is commonly tackled by fitting a regression function, which can then be used to estimate the candidate algorithms’ runtimes for new problem instances. In this paper, we develop a new approach to algorithm selection that combines regression with ranking, also known as learning to rank, a problem that has recently been studied in the realm of preference learning. Since only the ranking of the algorithms is eventually needed for the purpose of selection, the precise numerical estimation of runtimes appears to be a dispensable and unnecessarily difficult problem. However, discarding the numerical runtime information completely seems to be a bad idea, as we hide potentially useful information about the algorithms’ performance margins from the learner. Extensive experimental studies confirm the potential of our hybrid approach, showing that it often performs better than pure regression and pure ranking methods.

AB - Algorithm selection (AS) is defined as the task of automatically selecting the most suitable algorithm from a set of candidate algorithms for a specific instance of an algorithmic problem class. While suitability may refer to different criteria, runtime is of specific practical relevance. Leveraging empirical runtime information as training data, the AS problem is commonly tackled by fitting a regression function, which can then be used to estimate the candidate algorithms’ runtimes for new problem instances. In this paper, we develop a new approach to algorithm selection that combines regression with ranking, also known as learning to rank, a problem that has recently been studied in the realm of preference learning. Since only the ranking of the algorithms is eventually needed for the purpose of selection, the precise numerical estimation of runtimes appears to be a dispensable and unnecessarily difficult problem. However, discarding the numerical runtime information completely seems to be a bad idea, as we hide potentially useful information about the algorithms’ performance margins from the learner. Extensive experimental studies confirm the potential of our hybrid approach, showing that it often performs better than pure regression and pure ranking methods.

KW - Algorithm selection

KW - Combined ranking and regression

KW - Hybrid loss optimization

UR - http://www.scopus.com/inward/record.url?scp=85091138296&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-58285-2_5

DO - 10.1007/978-3-030-58285-2_5

M3 - Conference contribution

SN - 9783030582845

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 59

EP - 72

BT - KI 2020

A2 - Schmid, Ute

A2 - Wolter, Diedrich

A2 - Klügl, Franziska

PB - Springer Science and Business Media Deutschland GmbH

T2 - 43rd German Conference on Artificial Intelligence, KI 2020

Y2 - 21 September 2020 through 25 September 2020

ER -

Von denselben Autoren