Portfolio Search and Optimization for General Strategy Game-Playing

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

External Research Organisations

  • Queen Mary University of London
View graph of relations

Details

Original languageEnglish
Title of host publication2021 IEEE Congress on Evolutionary Computation, CEC 2021 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages2085-2092
Number of pages8
ISBN (electronic)9781728183923
Publication statusPublished - 2021
Externally publishedYes
Event2021 IEEE Congress on Evolutionary Computation, CEC 2021 - Virtual, Krakow, Poland
Duration: 28 Jun 20211 Jul 2021

Publication series

Name2021 IEEE Congress on Evolutionary Computation, CEC 2021 - Proceedings

Abstract

Portfolio methods represent a simple but efficient type of action abstraction which has shown to improve the performance of search-based agents in a range of strategy games. We first review existing portfolio techniques and propose a new algorithm for optimization and action-selection based on the Rolling Horizon Evolutionary Algorithm. Moreover, a series of variants are developed to solve problems in different aspects. We further analyze the performance of discussed agents in a general strategy game-playing task. For this purpose, we run experiments on three different game-modes of the STRATEGA framework. For the optimization of the agents' parameters and portfolio sets we study the use of the N-tuple Bandit Evolutionary Algorithm. The resulting portfolio sets suggest a high diversity in play-styles while being able to consistently beat the sample agents. An analysis of the agents' performance shows that the proposed algorithm generalizes well to all game-modes and is able to outperform other portfolio methods.

Keywords

    General strategy game-playing, N-tuple bandit evolutionary algorithm, Portfolio methods, Stratega

ASJC Scopus subject areas

Cite this

Portfolio Search and Optimization for General Strategy Game-Playing. / Dockhorn, Alexander; Hurtado-Grueso, Jorge; Jeurissen, Dominik et al.
2021 IEEE Congress on Evolutionary Computation, CEC 2021 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2021. p. 2085-2092 (2021 IEEE Congress on Evolutionary Computation, CEC 2021 - Proceedings).

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Dockhorn, A, Hurtado-Grueso, J, Jeurissen, D, Xu, L & Perez-Liebana, D 2021, Portfolio Search and Optimization for General Strategy Game-Playing. in 2021 IEEE Congress on Evolutionary Computation, CEC 2021 - Proceedings. 2021 IEEE Congress on Evolutionary Computation, CEC 2021 - Proceedings, Institute of Electrical and Electronics Engineers Inc., pp. 2085-2092, 2021 IEEE Congress on Evolutionary Computation, CEC 2021, Virtual, Krakow, Poland, 28 Jun 2021. https://doi.org/10.1109/CEC45853.2021.9504824
Dockhorn, A., Hurtado-Grueso, J., Jeurissen, D., Xu, L., & Perez-Liebana, D. (2021). Portfolio Search and Optimization for General Strategy Game-Playing. In 2021 IEEE Congress on Evolutionary Computation, CEC 2021 - Proceedings (pp. 2085-2092). (2021 IEEE Congress on Evolutionary Computation, CEC 2021 - Proceedings). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/CEC45853.2021.9504824
Dockhorn A, Hurtado-Grueso J, Jeurissen D, Xu L, Perez-Liebana D. Portfolio Search and Optimization for General Strategy Game-Playing. In 2021 IEEE Congress on Evolutionary Computation, CEC 2021 - Proceedings. Institute of Electrical and Electronics Engineers Inc. 2021. p. 2085-2092. (2021 IEEE Congress on Evolutionary Computation, CEC 2021 - Proceedings). doi: 10.1109/CEC45853.2021.9504824
Dockhorn, Alexander ; Hurtado-Grueso, Jorge ; Jeurissen, Dominik et al. / Portfolio Search and Optimization for General Strategy Game-Playing. 2021 IEEE Congress on Evolutionary Computation, CEC 2021 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2021. pp. 2085-2092 (2021 IEEE Congress on Evolutionary Computation, CEC 2021 - Proceedings).
Download
@inproceedings{06610065a24142afa2196165daa578c1,
title = "Portfolio Search and Optimization for General Strategy Game-Playing",
abstract = "Portfolio methods represent a simple but efficient type of action abstraction which has shown to improve the performance of search-based agents in a range of strategy games. We first review existing portfolio techniques and propose a new algorithm for optimization and action-selection based on the Rolling Horizon Evolutionary Algorithm. Moreover, a series of variants are developed to solve problems in different aspects. We further analyze the performance of discussed agents in a general strategy game-playing task. For this purpose, we run experiments on three different game-modes of the STRATEGA framework. For the optimization of the agents' parameters and portfolio sets we study the use of the N-tuple Bandit Evolutionary Algorithm. The resulting portfolio sets suggest a high diversity in play-styles while being able to consistently beat the sample agents. An analysis of the agents' performance shows that the proposed algorithm generalizes well to all game-modes and is able to outperform other portfolio methods.",
keywords = "General strategy game-playing, N-tuple bandit evolutionary algorithm, Portfolio methods, Stratega",
author = "Alexander Dockhorn and Jorge Hurtado-Grueso and Dominik Jeurissen and Linjie Xu and Diego Perez-Liebana",
note = "Funding Information: ACKNOWLEDGEMENTS This work is supported by UK EPSRC research grant EP/T008962/1 (https://gaigresearch.github.io/afm/).; 2021 IEEE Congress on Evolutionary Computation, CEC 2021 ; Conference date: 28-06-2021 Through 01-07-2021",
year = "2021",
doi = "10.1109/CEC45853.2021.9504824",
language = "English",
series = "2021 IEEE Congress on Evolutionary Computation, CEC 2021 - Proceedings",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "2085--2092",
booktitle = "2021 IEEE Congress on Evolutionary Computation, CEC 2021 - Proceedings",
address = "United States",

}

Download

TY - GEN

T1 - Portfolio Search and Optimization for General Strategy Game-Playing

AU - Dockhorn, Alexander

AU - Hurtado-Grueso, Jorge

AU - Jeurissen, Dominik

AU - Xu, Linjie

AU - Perez-Liebana, Diego

N1 - Funding Information: ACKNOWLEDGEMENTS This work is supported by UK EPSRC research grant EP/T008962/1 (https://gaigresearch.github.io/afm/).

PY - 2021

Y1 - 2021

N2 - Portfolio methods represent a simple but efficient type of action abstraction which has shown to improve the performance of search-based agents in a range of strategy games. We first review existing portfolio techniques and propose a new algorithm for optimization and action-selection based on the Rolling Horizon Evolutionary Algorithm. Moreover, a series of variants are developed to solve problems in different aspects. We further analyze the performance of discussed agents in a general strategy game-playing task. For this purpose, we run experiments on three different game-modes of the STRATEGA framework. For the optimization of the agents' parameters and portfolio sets we study the use of the N-tuple Bandit Evolutionary Algorithm. The resulting portfolio sets suggest a high diversity in play-styles while being able to consistently beat the sample agents. An analysis of the agents' performance shows that the proposed algorithm generalizes well to all game-modes and is able to outperform other portfolio methods.

AB - Portfolio methods represent a simple but efficient type of action abstraction which has shown to improve the performance of search-based agents in a range of strategy games. We first review existing portfolio techniques and propose a new algorithm for optimization and action-selection based on the Rolling Horizon Evolutionary Algorithm. Moreover, a series of variants are developed to solve problems in different aspects. We further analyze the performance of discussed agents in a general strategy game-playing task. For this purpose, we run experiments on three different game-modes of the STRATEGA framework. For the optimization of the agents' parameters and portfolio sets we study the use of the N-tuple Bandit Evolutionary Algorithm. The resulting portfolio sets suggest a high diversity in play-styles while being able to consistently beat the sample agents. An analysis of the agents' performance shows that the proposed algorithm generalizes well to all game-modes and is able to outperform other portfolio methods.

KW - General strategy game-playing

KW - N-tuple bandit evolutionary algorithm

KW - Portfolio methods

KW - Stratega

UR - http://www.scopus.com/inward/record.url?scp=85110943253&partnerID=8YFLogxK

U2 - 10.1109/CEC45853.2021.9504824

DO - 10.1109/CEC45853.2021.9504824

M3 - Conference contribution

AN - SCOPUS:85110943253

T3 - 2021 IEEE Congress on Evolutionary Computation, CEC 2021 - Proceedings

SP - 2085

EP - 2092

BT - 2021 IEEE Congress on Evolutionary Computation, CEC 2021 - Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2021 IEEE Congress on Evolutionary Computation, CEC 2021

Y2 - 28 June 2021 through 1 July 2021

ER -

By the same author(s)