Details
| Originalsprache | Englisch |
|---|---|
| Titel des Sammelwerks | 2017 IEEE Symposium Series on Computational Intelligence, SSCI 2017 - Proceedings |
| Herausgeber (Verlag) | Institute of Electrical and Electronics Engineers Inc. |
| Seiten | 1-8 |
| Seitenumfang | 8 |
| ISBN (elektronisch) | 9781538627259 |
| Publikationsstatus | Veröffentlicht - 2 Feb. 2018 |
| Extern publiziert | Ja |
| Veranstaltung | 2017 IEEE Symposium Series on Computational Intelligence, SSCI 2017 - Honolulu, USA / Vereinigte Staaten Dauer: 27 Nov. 2017 → 1 Dez. 2017 |
Publikationsreihe
| Name | 2017 IEEE Symposium Series on Computational Intelligence, SSCI 2017 - Proceedings |
|---|---|
| Band | 2018-January |
Abstract
This work builds up on previous research by Sievers and Helmert, who developed an Monte Carlo Tree Search based doppelkopf agent. This four player card game features a larger state space than skat due to the unknown cards of the contestants. Additionally, players face the unique problem of not knowing their teammates at the start of the game. Figuring out the player parties is a key feature of this card game and demands differing play styles depending on the current knowledge of the game state. In this work we enhance the Monte Carlo Tree Search agent created by Sievers and Helmert with a decision heuristic. Our goal is to improve the quality of playouts, by suggesting high quality moves and predicting enemy moves based on a neural network classifier. This classifier is trained on an extensive history of expert player moves recorded during official doppelkopf tournaments. Different network architectures are discussed and evaluated based on their prediction accuracy. The best performing network was tested in a direct comparison with the previous Monte Carlo Tree Search agent by Sievers and Helmert. We show that high quality predictions increase the quality of playouts. Overall, our simulations show that adding the decision heuristic increased the strength of play under comparable computational effort.
ASJC Scopus Sachgebiete
- Informatik (insg.)
- Artificial intelligence
- Informatik (insg.)
- Angewandte Informatik
- Mathematik (insg.)
- Steuerung und Optimierung
Zitieren
- Standard
- Harvard
- Apa
- Vancouver
- BibTex
- RIS
2017 IEEE Symposium Series on Computational Intelligence, SSCI 2017 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2018. S. 1-8 (2017 IEEE Symposium Series on Computational Intelligence, SSCI 2017 - Proceedings; Band 2018-January).
Publikation: Beitrag in Buch/Bericht/Sammelwerk/Konferenzband › Aufsatz in Konferenzband › Forschung › Peer-Review
}
TY - GEN
T1 - A decision heuristic for Monte Carlo tree search doppelkopf agents
AU - Dockhorn, Alexander
AU - Doell, Christoph
AU - Hewelt, Matthias
AU - Kruse, Rudolf
N1 - Publisher Copyright: © 2017 IEEE.
PY - 2018/2/2
Y1 - 2018/2/2
N2 - This work builds up on previous research by Sievers and Helmert, who developed an Monte Carlo Tree Search based doppelkopf agent. This four player card game features a larger state space than skat due to the unknown cards of the contestants. Additionally, players face the unique problem of not knowing their teammates at the start of the game. Figuring out the player parties is a key feature of this card game and demands differing play styles depending on the current knowledge of the game state. In this work we enhance the Monte Carlo Tree Search agent created by Sievers and Helmert with a decision heuristic. Our goal is to improve the quality of playouts, by suggesting high quality moves and predicting enemy moves based on a neural network classifier. This classifier is trained on an extensive history of expert player moves recorded during official doppelkopf tournaments. Different network architectures are discussed and evaluated based on their prediction accuracy. The best performing network was tested in a direct comparison with the previous Monte Carlo Tree Search agent by Sievers and Helmert. We show that high quality predictions increase the quality of playouts. Overall, our simulations show that adding the decision heuristic increased the strength of play under comparable computational effort.
AB - This work builds up on previous research by Sievers and Helmert, who developed an Monte Carlo Tree Search based doppelkopf agent. This four player card game features a larger state space than skat due to the unknown cards of the contestants. Additionally, players face the unique problem of not knowing their teammates at the start of the game. Figuring out the player parties is a key feature of this card game and demands differing play styles depending on the current knowledge of the game state. In this work we enhance the Monte Carlo Tree Search agent created by Sievers and Helmert with a decision heuristic. Our goal is to improve the quality of playouts, by suggesting high quality moves and predicting enemy moves based on a neural network classifier. This classifier is trained on an extensive history of expert player moves recorded during official doppelkopf tournaments. Different network architectures are discussed and evaluated based on their prediction accuracy. The best performing network was tested in a direct comparison with the previous Monte Carlo Tree Search agent by Sievers and Helmert. We show that high quality predictions increase the quality of playouts. Overall, our simulations show that adding the decision heuristic increased the strength of play under comparable computational effort.
UR - http://www.scopus.com/inward/record.url?scp=85046116412&partnerID=8YFLogxK
U2 - 10.1109/SSCI.2017.8285181
DO - 10.1109/SSCI.2017.8285181
M3 - Conference contribution
T3 - 2017 IEEE Symposium Series on Computational Intelligence, SSCI 2017 - Proceedings
SP - 1
EP - 8
BT - 2017 IEEE Symposium Series on Computational Intelligence, SSCI 2017 - Proceedings
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2017 IEEE Symposium Series on Computational Intelligence, SSCI 2017
Y2 - 27 November 2017 through 1 December 2017
ER -