Forward Model Learning for Motion Control Tasks

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Autoren

Externe Organisationen

  • Queen Mary University of London
  • Otto-von-Guericke-Universität Magdeburg
Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Titel des Sammelwerks2020 IEEE 10th International Conference on Intelligent Systems, IS 2020 - Proceedings
Herausgeber/-innenVassil Sgurev, Vladimir Jotsov, Rudolf Kruse, Mincho Hadjiski
Herausgeber (Verlag)Institute of Electrical and Electronics Engineers Inc.
Seiten551-556
Seitenumfang6
ISBN (elektronisch)9781728154565
PublikationsstatusVeröffentlicht - Aug. 2020
Extern publiziertJa
Veranstaltung10th IEEE International Conference on Intelligent Systems, IS 2020 - Sofia, Bulgarien
Dauer: 28 Aug. 202030 Aug. 2020

Publikationsreihe

Name2020 IEEE 10th International Conference on Intelligent Systems, IS 2020 - Proceedings

Abstract

In this work, we study the capabilities and limitations of forward model learning agents and their applications to motion-control tasks. Forward model learning agents learn to approximate the environment dynamics to apply planning algorithms for action-selection. While previous work has shown that forward model learning agents can efficiently learn to play simple video games, we extend their applicability to domains with continuous state and action spaces. Our experiments show that such agents are quickly able to learn an approximate model of their environment, which suffices to solve several simple motion-control tasks. Comparisons with deep reinforcement learning further highlight the sample efficiency of forward model learning agents.

ASJC Scopus Sachgebiete

Zitieren

Forward Model Learning for Motion Control Tasks. / Dockhorn, Alexander; Kruse, Rudolf.
2020 IEEE 10th International Conference on Intelligent Systems, IS 2020 - Proceedings. Hrsg. / Vassil Sgurev; Vladimir Jotsov; Rudolf Kruse; Mincho Hadjiski. Institute of Electrical and Electronics Engineers Inc., 2020. S. 551-556 9199978 (2020 IEEE 10th International Conference on Intelligent Systems, IS 2020 - Proceedings).

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Dockhorn, A & Kruse, R 2020, Forward Model Learning for Motion Control Tasks. in V Sgurev, V Jotsov, R Kruse & M Hadjiski (Hrsg.), 2020 IEEE 10th International Conference on Intelligent Systems, IS 2020 - Proceedings., 9199978, 2020 IEEE 10th International Conference on Intelligent Systems, IS 2020 - Proceedings, Institute of Electrical and Electronics Engineers Inc., S. 551-556, 10th IEEE International Conference on Intelligent Systems, IS 2020, Sofia, Bulgarien, 28 Aug. 2020. https://doi.org/10.1109/IS48319.2020.9199978
Dockhorn, A., & Kruse, R. (2020). Forward Model Learning for Motion Control Tasks. In V. Sgurev, V. Jotsov, R. Kruse, & M. Hadjiski (Hrsg.), 2020 IEEE 10th International Conference on Intelligent Systems, IS 2020 - Proceedings (S. 551-556). Artikel 9199978 (2020 IEEE 10th International Conference on Intelligent Systems, IS 2020 - Proceedings). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IS48319.2020.9199978
Dockhorn A, Kruse R. Forward Model Learning for Motion Control Tasks. in Sgurev V, Jotsov V, Kruse R, Hadjiski M, Hrsg., 2020 IEEE 10th International Conference on Intelligent Systems, IS 2020 - Proceedings. Institute of Electrical and Electronics Engineers Inc. 2020. S. 551-556. 9199978. (2020 IEEE 10th International Conference on Intelligent Systems, IS 2020 - Proceedings). doi: 10.1109/IS48319.2020.9199978
Dockhorn, Alexander ; Kruse, Rudolf. / Forward Model Learning for Motion Control Tasks. 2020 IEEE 10th International Conference on Intelligent Systems, IS 2020 - Proceedings. Hrsg. / Vassil Sgurev ; Vladimir Jotsov ; Rudolf Kruse ; Mincho Hadjiski. Institute of Electrical and Electronics Engineers Inc., 2020. S. 551-556 (2020 IEEE 10th International Conference on Intelligent Systems, IS 2020 - Proceedings).
Download
@inproceedings{a198d82e8786443280c7823d8e82fbc0,
title = "Forward Model Learning for Motion Control Tasks",
abstract = "In this work, we study the capabilities and limitations of forward model learning agents and their applications to motion-control tasks. Forward model learning agents learn to approximate the environment dynamics to apply planning algorithms for action-selection. While previous work has shown that forward model learning agents can efficiently learn to play simple video games, we extend their applicability to domains with continuous state and action spaces. Our experiments show that such agents are quickly able to learn an approximate model of their environment, which suffices to solve several simple motion-control tasks. Comparisons with deep reinforcement learning further highlight the sample efficiency of forward model learning agents.",
keywords = "Deep Reinforcement Learning, Forward Model Learning, Motion Control Tasks",
author = "Alexander Dockhorn and Rudolf Kruse",
year = "2020",
month = aug,
doi = "10.1109/IS48319.2020.9199978",
language = "English",
series = "2020 IEEE 10th International Conference on Intelligent Systems, IS 2020 - Proceedings",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "551--556",
editor = "Vassil Sgurev and Vladimir Jotsov and Rudolf Kruse and Mincho Hadjiski",
booktitle = "2020 IEEE 10th International Conference on Intelligent Systems, IS 2020 - Proceedings",
address = "United States",
note = "10th IEEE International Conference on Intelligent Systems, IS 2020 ; Conference date: 28-08-2020 Through 30-08-2020",

}

Download

TY - GEN

T1 - Forward Model Learning for Motion Control Tasks

AU - Dockhorn, Alexander

AU - Kruse, Rudolf

PY - 2020/8

Y1 - 2020/8

N2 - In this work, we study the capabilities and limitations of forward model learning agents and their applications to motion-control tasks. Forward model learning agents learn to approximate the environment dynamics to apply planning algorithms for action-selection. While previous work has shown that forward model learning agents can efficiently learn to play simple video games, we extend their applicability to domains with continuous state and action spaces. Our experiments show that such agents are quickly able to learn an approximate model of their environment, which suffices to solve several simple motion-control tasks. Comparisons with deep reinforcement learning further highlight the sample efficiency of forward model learning agents.

AB - In this work, we study the capabilities and limitations of forward model learning agents and their applications to motion-control tasks. Forward model learning agents learn to approximate the environment dynamics to apply planning algorithms for action-selection. While previous work has shown that forward model learning agents can efficiently learn to play simple video games, we extend their applicability to domains with continuous state and action spaces. Our experiments show that such agents are quickly able to learn an approximate model of their environment, which suffices to solve several simple motion-control tasks. Comparisons with deep reinforcement learning further highlight the sample efficiency of forward model learning agents.

KW - Deep Reinforcement Learning

KW - Forward Model Learning

KW - Motion Control Tasks

UR - http://www.scopus.com/inward/record.url?scp=85092707661&partnerID=8YFLogxK

U2 - 10.1109/IS48319.2020.9199978

DO - 10.1109/IS48319.2020.9199978

M3 - Conference contribution

AN - SCOPUS:85092707661

T3 - 2020 IEEE 10th International Conference on Intelligent Systems, IS 2020 - Proceedings

SP - 551

EP - 556

BT - 2020 IEEE 10th International Conference on Intelligent Systems, IS 2020 - Proceedings

A2 - Sgurev, Vassil

A2 - Jotsov, Vladimir

A2 - Kruse, Rudolf

A2 - Hadjiski, Mincho

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 10th IEEE International Conference on Intelligent Systems, IS 2020

Y2 - 28 August 2020 through 30 August 2020

ER -

Von denselben Autoren