Strategy Game-Playing with Size-Constrained State Abstraction

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

Research Organisations

External Research Organisations

  • Queen Mary University of London
View graph of relations

Details

Original languageEnglish
Title of host publicationProceedings of the 2024 IEEE Conference on Games, CoG 2024
PublisherIEEE Computer Society
ISBN (electronic)9798350350678
ISBN (print)979-8-3503-5068-5
Publication statusPublished - 28 Aug 2024
Event6th Annual IEEE Conference on Games, CoG 2024 - Milan, Italy
Duration: 5 Aug 20248 Aug 2024

Publication series

NameIEEE Conference on Computatonal Intelligence and Games, CIG
ISSN (Print)2325-4270
ISSN (electronic)2325-4289

Abstract

Playing strategy games is a challenging problem for artificial intelligence (AI). One of the major challenges is the large search space due to a diverse set of game components. In recent works, state abstraction has been applied to search-based game AI and has brought significant performance improvements. State abstraction techniques rely on reducing the search space, e.g., by aggregating similar states. However, the application of these abstractions is hindered because the quality of an abstraction is difficult to evaluate. Previous works hence abandon the abstraction in the middle of the search to not bias the search to a local optimum. This mechanism introduces a hyper-parameter to decide the time to abandon the current state abstraction. In this work, we propose a size-constrained state abstraction (SCSA), an approach that limits the maximum number of nodes being grouped together. We found that with SCSA, the abstraction is not required to be abandoned. Our empirical results on 3 strategy games show that the SCSA agent outperforms the previous methods and yields robust performance over different games. Codes are opensourced at https://anonymous.4open.science/r/SCSA-DB44/.

Keywords

    Game artificial intelligence, monte carlo tree search, planning, state abstraction

ASJC Scopus subject areas

Cite this

Strategy Game-Playing with Size-Constrained State Abstraction. / Xu, Linjie; Perez-Liebana, Diego; Dockhorn, Alexander.
Proceedings of the 2024 IEEE Conference on Games, CoG 2024. IEEE Computer Society, 2024. (IEEE Conference on Computatonal Intelligence and Games, CIG).

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Xu, L, Perez-Liebana, D & Dockhorn, A 2024, Strategy Game-Playing with Size-Constrained State Abstraction. in Proceedings of the 2024 IEEE Conference on Games, CoG 2024. IEEE Conference on Computatonal Intelligence and Games, CIG, IEEE Computer Society, 6th Annual IEEE Conference on Games, CoG 2024, Milan, Italy, 5 Aug 2024. https://doi.org/10.48550/arXiv.2408.06202, https://doi.org/10.1109/CoG60054.2024.10645643
Xu, L., Perez-Liebana, D., & Dockhorn, A. (2024). Strategy Game-Playing with Size-Constrained State Abstraction. In Proceedings of the 2024 IEEE Conference on Games, CoG 2024 (IEEE Conference on Computatonal Intelligence and Games, CIG). IEEE Computer Society. https://doi.org/10.48550/arXiv.2408.06202, https://doi.org/10.1109/CoG60054.2024.10645643
Xu L, Perez-Liebana D, Dockhorn A. Strategy Game-Playing with Size-Constrained State Abstraction. In Proceedings of the 2024 IEEE Conference on Games, CoG 2024. IEEE Computer Society. 2024. (IEEE Conference on Computatonal Intelligence and Games, CIG). doi: 10.48550/arXiv.2408.06202, 10.1109/CoG60054.2024.10645643
Xu, Linjie ; Perez-Liebana, Diego ; Dockhorn, Alexander. / Strategy Game-Playing with Size-Constrained State Abstraction. Proceedings of the 2024 IEEE Conference on Games, CoG 2024. IEEE Computer Society, 2024. (IEEE Conference on Computatonal Intelligence and Games, CIG).
Download
@inproceedings{6dd23fde7a7447b08e3a23c859ffd259,
title = "Strategy Game-Playing with Size-Constrained State Abstraction",
abstract = "Playing strategy games is a challenging problem for artificial intelligence (AI). One of the major challenges is the large search space due to a diverse set of game components. In recent works, state abstraction has been applied to search-based game AI and has brought significant performance improvements. State abstraction techniques rely on reducing the search space, e.g., by aggregating similar states. However, the application of these abstractions is hindered because the quality of an abstraction is difficult to evaluate. Previous works hence abandon the abstraction in the middle of the search to not bias the search to a local optimum. This mechanism introduces a hyper-parameter to decide the time to abandon the current state abstraction. In this work, we propose a size-constrained state abstraction (SCSA), an approach that limits the maximum number of nodes being grouped together. We found that with SCSA, the abstraction is not required to be abandoned. Our empirical results on 3 strategy games show that the SCSA agent outperforms the previous methods and yields robust performance over different games. Codes are opensourced at https://anonymous.4open.science/r/SCSA-DB44/.",
keywords = "Game artificial intelligence, monte carlo tree search, planning, state abstraction",
author = "Linjie Xu and Diego Perez-Liebana and Alexander Dockhorn",
note = "Publisher Copyright: {\textcopyright} 2024 IEEE.; 6th Annual IEEE Conference on Games, CoG 2024 ; Conference date: 05-08-2024 Through 08-08-2024",
year = "2024",
month = aug,
day = "28",
doi = "10.48550/arXiv.2408.06202",
language = "English",
isbn = "979-8-3503-5068-5",
series = "IEEE Conference on Computatonal Intelligence and Games, CIG",
publisher = "IEEE Computer Society",
booktitle = "Proceedings of the 2024 IEEE Conference on Games, CoG 2024",
address = "United States",

}

Download

TY - GEN

T1 - Strategy Game-Playing with Size-Constrained State Abstraction

AU - Xu, Linjie

AU - Perez-Liebana, Diego

AU - Dockhorn, Alexander

N1 - Publisher Copyright: © 2024 IEEE.

PY - 2024/8/28

Y1 - 2024/8/28

N2 - Playing strategy games is a challenging problem for artificial intelligence (AI). One of the major challenges is the large search space due to a diverse set of game components. In recent works, state abstraction has been applied to search-based game AI and has brought significant performance improvements. State abstraction techniques rely on reducing the search space, e.g., by aggregating similar states. However, the application of these abstractions is hindered because the quality of an abstraction is difficult to evaluate. Previous works hence abandon the abstraction in the middle of the search to not bias the search to a local optimum. This mechanism introduces a hyper-parameter to decide the time to abandon the current state abstraction. In this work, we propose a size-constrained state abstraction (SCSA), an approach that limits the maximum number of nodes being grouped together. We found that with SCSA, the abstraction is not required to be abandoned. Our empirical results on 3 strategy games show that the SCSA agent outperforms the previous methods and yields robust performance over different games. Codes are opensourced at https://anonymous.4open.science/r/SCSA-DB44/.

AB - Playing strategy games is a challenging problem for artificial intelligence (AI). One of the major challenges is the large search space due to a diverse set of game components. In recent works, state abstraction has been applied to search-based game AI and has brought significant performance improvements. State abstraction techniques rely on reducing the search space, e.g., by aggregating similar states. However, the application of these abstractions is hindered because the quality of an abstraction is difficult to evaluate. Previous works hence abandon the abstraction in the middle of the search to not bias the search to a local optimum. This mechanism introduces a hyper-parameter to decide the time to abandon the current state abstraction. In this work, we propose a size-constrained state abstraction (SCSA), an approach that limits the maximum number of nodes being grouped together. We found that with SCSA, the abstraction is not required to be abandoned. Our empirical results on 3 strategy games show that the SCSA agent outperforms the previous methods and yields robust performance over different games. Codes are opensourced at https://anonymous.4open.science/r/SCSA-DB44/.

KW - Game artificial intelligence

KW - monte carlo tree search

KW - planning

KW - state abstraction

UR - http://www.scopus.com/inward/record.url?scp=85203538562&partnerID=8YFLogxK

U2 - 10.48550/arXiv.2408.06202

DO - 10.48550/arXiv.2408.06202

M3 - Conference contribution

AN - SCOPUS:85203538562

SN - 979-8-3503-5068-5

T3 - IEEE Conference on Computatonal Intelligence and Games, CIG

BT - Proceedings of the 2024 IEEE Conference on Games, CoG 2024

PB - IEEE Computer Society

T2 - 6th Annual IEEE Conference on Games, CoG 2024

Y2 - 5 August 2024 through 8 August 2024

ER -

By the same author(s)