Collective Iterative Learning Control: Exploiting Diversity in Multi-Agent Systems for Reference Tracking Tasks

Research output: Contribution to journalArticleResearchpeer review

Authors

External Research Organisations

  • University of Applied Sciences Karlsruhe (HKA)
  • Technische Universität Berlin
  • Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU Erlangen-Nürnberg)
View graph of relations

Details

Original languageEnglish
Pages (from-to)1390-1402
Number of pages13
JournalIEEE Transactions on Control Systems Technology
Volume30
Issue number4
Publication statusPublished - 1 Jul 2022
Externally publishedYes

Abstract

Multi-agent systems (MASs) can autonomously learn to solve previously unknown tasks by means of each agent's individual intelligence as well as by collaborating and exploiting collective intelligence. This article considers a group of autonomous agents learning to track the same given reference trajectory in a possibly small number of trials. We propose a novel collective learning control method that combines iterative learning control (ILC) with a collective update strategy. We derive conditions for desirable convergence properties of such systems. We show that the proposed method allows the collective to combine the advantages of the agents' individual learning strategies and thereby overcomes trade-offs and limitations of single-agent ILC. This benefit is achieved by designing a heterogeneous collective, i.e., a different learning law is assigned to each agent. All theoretical results are confirmed in simulations and experiments with two-wheeled-inverted-pendulum robots (TWIPRs) that jointly learn to perform the desired maneuver.

Keywords

    Autonomous systems, collective intelligence, cooperative systems, iterative learning control (ILC)

ASJC Scopus subject areas

Cite this

Collective Iterative Learning Control: Exploiting Diversity in Multi-Agent Systems for Reference Tracking Tasks. / Meindl, Michael; Molinari, Fabio; Lehmann, Dustin et al.
In: IEEE Transactions on Control Systems Technology, Vol. 30, No. 4, 01.07.2022, p. 1390-1402.

Research output: Contribution to journalArticleResearchpeer review

Meindl M, Molinari F, Lehmann D, Seel T. Collective Iterative Learning Control: Exploiting Diversity in Multi-Agent Systems for Reference Tracking Tasks. IEEE Transactions on Control Systems Technology. 2022 Jul 1;30(4):1390-1402. doi: 10.1109/TCST.2021.3109646, 10.48550/arXiv.2104.07620
Meindl, Michael ; Molinari, Fabio ; Lehmann, Dustin et al. / Collective Iterative Learning Control : Exploiting Diversity in Multi-Agent Systems for Reference Tracking Tasks. In: IEEE Transactions on Control Systems Technology. 2022 ; Vol. 30, No. 4. pp. 1390-1402.
Download
@article{f6fd37d56f5546febe089ffa8832622a,
title = "Collective Iterative Learning Control: Exploiting Diversity in Multi-Agent Systems for Reference Tracking Tasks",
abstract = "Multi-agent systems (MASs) can autonomously learn to solve previously unknown tasks by means of each agent's individual intelligence as well as by collaborating and exploiting collective intelligence. This article considers a group of autonomous agents learning to track the same given reference trajectory in a possibly small number of trials. We propose a novel collective learning control method that combines iterative learning control (ILC) with a collective update strategy. We derive conditions for desirable convergence properties of such systems. We show that the proposed method allows the collective to combine the advantages of the agents' individual learning strategies and thereby overcomes trade-offs and limitations of single-agent ILC. This benefit is achieved by designing a heterogeneous collective, i.e., a different learning law is assigned to each agent. All theoretical results are confirmed in simulations and experiments with two-wheeled-inverted-pendulum robots (TWIPRs) that jointly learn to perform the desired maneuver.",
keywords = "Autonomous systems, collective intelligence, cooperative systems, iterative learning control (ILC)",
author = "Michael Meindl and Fabio Molinari and Dustin Lehmann and Thomas Seel",
year = "2022",
month = jul,
day = "1",
doi = "10.1109/TCST.2021.3109646",
language = "English",
volume = "30",
pages = "1390--1402",
journal = "IEEE Transactions on Control Systems Technology",
issn = "1063-6536",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "4",

}

Download

TY - JOUR

T1 - Collective Iterative Learning Control

T2 - Exploiting Diversity in Multi-Agent Systems for Reference Tracking Tasks

AU - Meindl, Michael

AU - Molinari, Fabio

AU - Lehmann, Dustin

AU - Seel, Thomas

PY - 2022/7/1

Y1 - 2022/7/1

N2 - Multi-agent systems (MASs) can autonomously learn to solve previously unknown tasks by means of each agent's individual intelligence as well as by collaborating and exploiting collective intelligence. This article considers a group of autonomous agents learning to track the same given reference trajectory in a possibly small number of trials. We propose a novel collective learning control method that combines iterative learning control (ILC) with a collective update strategy. We derive conditions for desirable convergence properties of such systems. We show that the proposed method allows the collective to combine the advantages of the agents' individual learning strategies and thereby overcomes trade-offs and limitations of single-agent ILC. This benefit is achieved by designing a heterogeneous collective, i.e., a different learning law is assigned to each agent. All theoretical results are confirmed in simulations and experiments with two-wheeled-inverted-pendulum robots (TWIPRs) that jointly learn to perform the desired maneuver.

AB - Multi-agent systems (MASs) can autonomously learn to solve previously unknown tasks by means of each agent's individual intelligence as well as by collaborating and exploiting collective intelligence. This article considers a group of autonomous agents learning to track the same given reference trajectory in a possibly small number of trials. We propose a novel collective learning control method that combines iterative learning control (ILC) with a collective update strategy. We derive conditions for desirable convergence properties of such systems. We show that the proposed method allows the collective to combine the advantages of the agents' individual learning strategies and thereby overcomes trade-offs and limitations of single-agent ILC. This benefit is achieved by designing a heterogeneous collective, i.e., a different learning law is assigned to each agent. All theoretical results are confirmed in simulations and experiments with two-wheeled-inverted-pendulum robots (TWIPRs) that jointly learn to perform the desired maneuver.

KW - Autonomous systems

KW - collective intelligence

KW - cooperative systems

KW - iterative learning control (ILC)

UR - http://www.scopus.com/inward/record.url?scp=85133800829&partnerID=8YFLogxK

U2 - 10.1109/TCST.2021.3109646

DO - 10.1109/TCST.2021.3109646

M3 - Article

AN - SCOPUS:85133800829

VL - 30

SP - 1390

EP - 1402

JO - IEEE Transactions on Control Systems Technology

JF - IEEE Transactions on Control Systems Technology

SN - 1063-6536

IS - 4

ER -

By the same author(s)