Details
| Original language | English |
|---|---|
| Title of host publication | 2017 IEEE Symposium Series on Computational Intelligence, SSCI 2017 - Proceedings |
| Publisher | Institute of Electrical and Electronics Engineers Inc. |
| Pages | 1-8 |
| Number of pages | 8 |
| ISBN (electronic) | 9781538627259 |
| Publication status | Published - 2 Feb 2018 |
| Externally published | Yes |
| Event | 2017 IEEE Symposium Series on Computational Intelligence, SSCI 2017 - Honolulu, United States Duration: 27 Nov 2017 → 1 Dec 2017 |
Publication series
| Name | 2017 IEEE Symposium Series on Computational Intelligence, SSCI 2017 - Proceedings |
|---|---|
| Volume | 2018-January |
Abstract
This work builds up on previous research by Sievers and Helmert, who developed an Monte Carlo Tree Search based doppelkopf agent. This four player card game features a larger state space than skat due to the unknown cards of the contestants. Additionally, players face the unique problem of not knowing their teammates at the start of the game. Figuring out the player parties is a key feature of this card game and demands differing play styles depending on the current knowledge of the game state. In this work we enhance the Monte Carlo Tree Search agent created by Sievers and Helmert with a decision heuristic. Our goal is to improve the quality of playouts, by suggesting high quality moves and predicting enemy moves based on a neural network classifier. This classifier is trained on an extensive history of expert player moves recorded during official doppelkopf tournaments. Different network architectures are discussed and evaluated based on their prediction accuracy. The best performing network was tested in a direct comparison with the previous Monte Carlo Tree Search agent by Sievers and Helmert. We show that high quality predictions increase the quality of playouts. Overall, our simulations show that adding the decision heuristic increased the strength of play under comparable computational effort.
ASJC Scopus subject areas
- Computer Science(all)
- Artificial Intelligence
- Computer Science(all)
- Computer Science Applications
- Mathematics(all)
- Control and Optimization
Cite this
- Standard
- Harvard
- Apa
- Vancouver
- BibTeX
- RIS
2017 IEEE Symposium Series on Computational Intelligence, SSCI 2017 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2018. p. 1-8 (2017 IEEE Symposium Series on Computational Intelligence, SSCI 2017 - Proceedings; Vol. 2018-January).
Research output: Chapter in book/report/conference proceeding › Conference contribution › Research › peer review
}
TY - GEN
T1 - A decision heuristic for Monte Carlo tree search doppelkopf agents
AU - Dockhorn, Alexander
AU - Doell, Christoph
AU - Hewelt, Matthias
AU - Kruse, Rudolf
N1 - Publisher Copyright: © 2017 IEEE.
PY - 2018/2/2
Y1 - 2018/2/2
N2 - This work builds up on previous research by Sievers and Helmert, who developed an Monte Carlo Tree Search based doppelkopf agent. This four player card game features a larger state space than skat due to the unknown cards of the contestants. Additionally, players face the unique problem of not knowing their teammates at the start of the game. Figuring out the player parties is a key feature of this card game and demands differing play styles depending on the current knowledge of the game state. In this work we enhance the Monte Carlo Tree Search agent created by Sievers and Helmert with a decision heuristic. Our goal is to improve the quality of playouts, by suggesting high quality moves and predicting enemy moves based on a neural network classifier. This classifier is trained on an extensive history of expert player moves recorded during official doppelkopf tournaments. Different network architectures are discussed and evaluated based on their prediction accuracy. The best performing network was tested in a direct comparison with the previous Monte Carlo Tree Search agent by Sievers and Helmert. We show that high quality predictions increase the quality of playouts. Overall, our simulations show that adding the decision heuristic increased the strength of play under comparable computational effort.
AB - This work builds up on previous research by Sievers and Helmert, who developed an Monte Carlo Tree Search based doppelkopf agent. This four player card game features a larger state space than skat due to the unknown cards of the contestants. Additionally, players face the unique problem of not knowing their teammates at the start of the game. Figuring out the player parties is a key feature of this card game and demands differing play styles depending on the current knowledge of the game state. In this work we enhance the Monte Carlo Tree Search agent created by Sievers and Helmert with a decision heuristic. Our goal is to improve the quality of playouts, by suggesting high quality moves and predicting enemy moves based on a neural network classifier. This classifier is trained on an extensive history of expert player moves recorded during official doppelkopf tournaments. Different network architectures are discussed and evaluated based on their prediction accuracy. The best performing network was tested in a direct comparison with the previous Monte Carlo Tree Search agent by Sievers and Helmert. We show that high quality predictions increase the quality of playouts. Overall, our simulations show that adding the decision heuristic increased the strength of play under comparable computational effort.
UR - http://www.scopus.com/inward/record.url?scp=85046116412&partnerID=8YFLogxK
U2 - 10.1109/SSCI.2017.8285181
DO - 10.1109/SSCI.2017.8285181
M3 - Conference contribution
T3 - 2017 IEEE Symposium Series on Computational Intelligence, SSCI 2017 - Proceedings
SP - 1
EP - 8
BT - 2017 IEEE Symposium Series on Computational Intelligence, SSCI 2017 - Proceedings
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2017 IEEE Symposium Series on Computational Intelligence, SSCI 2017
Y2 - 27 November 2017 through 1 December 2017
ER -