Cooperative multi-agent system for production control using reinforcement learning

Research output: Contribution to journalArticleResearchpeer review

Authors

  • Marc-André Dittrich
  • Silas Fohlmeister
View graph of relations

Details

Original languageEnglish
Pages (from-to)389-392
Number of pages4
JournalCIRP Annals - Manufacturing Technology
Volume69
Issue number1
Early online date18 May 2020
Publication statusPublished - 2020

Abstract

Multi-agent systems can limit the control problem in complex production systems and solve them more efficiently. However, they often show local optimization tendencies. This paper presents a novel approach for a cooperative multi-agent system, which uses reinforcement learning and considers global key performance indicators. For this purpose, a central deep q-learning module transfers its knowledge to the cooperative order agents. The order agent's experience is stored in a replay memory for subsequent reinforcement learning. Interdependencies between the characteristics of nonlinear production systems and learning parameters are investigated and the performance is evaluated in comparison to conventional methods of production control.

Keywords

    Machine learning, Multi-agent system, Production planning

ASJC Scopus subject areas

Cite this

Cooperative multi-agent system for production control using reinforcement learning. / Dittrich, Marc-André; Fohlmeister, Silas.
In: CIRP Annals - Manufacturing Technology, Vol. 69, No. 1, 2020, p. 389-392.

Research output: Contribution to journalArticleResearchpeer review

Dittrich MA, Fohlmeister S. Cooperative multi-agent system for production control using reinforcement learning. CIRP Annals - Manufacturing Technology. 2020;69(1):389-392. Epub 2020 May 18. doi: 10.1016/j.cirp.2020.04.005
Dittrich, Marc-André ; Fohlmeister, Silas. / Cooperative multi-agent system for production control using reinforcement learning. In: CIRP Annals - Manufacturing Technology. 2020 ; Vol. 69, No. 1. pp. 389-392.
Download
@article{8e00252211264f6094d3f647ec24d039,
title = "Cooperative multi-agent system for production control using reinforcement learning",
abstract = "Multi-agent systems can limit the control problem in complex production systems and solve them more efficiently. However, they often show local optimization tendencies. This paper presents a novel approach for a cooperative multi-agent system, which uses reinforcement learning and considers global key performance indicators. For this purpose, a central deep q-learning module transfers its knowledge to the cooperative order agents. The order agent's experience is stored in a replay memory for subsequent reinforcement learning. Interdependencies between the characteristics of nonlinear production systems and learning parameters are investigated and the performance is evaluated in comparison to conventional methods of production control.",
keywords = "Machine learning, Multi-agent system, Production planning",
author = "Marc-Andr{\'e} Dittrich and Silas Fohlmeister",
note = "Funding information: The presented investigations were conducted within the research project DE 447/181-1. We would like to thank the German Research Foundation (DFG) for the support of this project. In addition, we would like to thank Berend Denkena for his valuable comments and his support.",
year = "2020",
doi = "10.1016/j.cirp.2020.04.005",
language = "English",
volume = "69",
pages = "389--392",
journal = "CIRP Annals - Manufacturing Technology",
issn = "0007-8506",
publisher = "Elsevier USA",
number = "1",

}

Download

TY - JOUR

T1 - Cooperative multi-agent system for production control using reinforcement learning

AU - Dittrich, Marc-André

AU - Fohlmeister, Silas

N1 - Funding information: The presented investigations were conducted within the research project DE 447/181-1. We would like to thank the German Research Foundation (DFG) for the support of this project. In addition, we would like to thank Berend Denkena for his valuable comments and his support.

PY - 2020

Y1 - 2020

N2 - Multi-agent systems can limit the control problem in complex production systems and solve them more efficiently. However, they often show local optimization tendencies. This paper presents a novel approach for a cooperative multi-agent system, which uses reinforcement learning and considers global key performance indicators. For this purpose, a central deep q-learning module transfers its knowledge to the cooperative order agents. The order agent's experience is stored in a replay memory for subsequent reinforcement learning. Interdependencies between the characteristics of nonlinear production systems and learning parameters are investigated and the performance is evaluated in comparison to conventional methods of production control.

AB - Multi-agent systems can limit the control problem in complex production systems and solve them more efficiently. However, they often show local optimization tendencies. This paper presents a novel approach for a cooperative multi-agent system, which uses reinforcement learning and considers global key performance indicators. For this purpose, a central deep q-learning module transfers its knowledge to the cooperative order agents. The order agent's experience is stored in a replay memory for subsequent reinforcement learning. Interdependencies between the characteristics of nonlinear production systems and learning parameters are investigated and the performance is evaluated in comparison to conventional methods of production control.

KW - Machine learning

KW - Multi-agent system

KW - Production planning

UR - http://www.scopus.com/inward/record.url?scp=85084728013&partnerID=8YFLogxK

U2 - 10.1016/j.cirp.2020.04.005

DO - 10.1016/j.cirp.2020.04.005

M3 - Article

VL - 69

SP - 389

EP - 392

JO - CIRP Annals - Manufacturing Technology

JF - CIRP Annals - Manufacturing Technology

SN - 0007-8506

IS - 1

ER -