Forward Model Learning for Motion Control Tasks

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

External Research Organisations

  • Queen Mary University of London
  • Otto-von-Guericke University Magdeburg
View graph of relations

Details

Original languageEnglish
Title of host publication2020 IEEE 10th International Conference on Intelligent Systems, IS 2020 - Proceedings
EditorsVassil Sgurev, Vladimir Jotsov, Rudolf Kruse, Mincho Hadjiski
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages551-556
Number of pages6
ISBN (electronic)9781728154565
Publication statusPublished - Aug 2020
Externally publishedYes
Event10th IEEE International Conference on Intelligent Systems, IS 2020 - Sofia, Bulgaria
Duration: 28 Aug 202030 Aug 2020

Publication series

Name2020 IEEE 10th International Conference on Intelligent Systems, IS 2020 - Proceedings

Abstract

In this work, we study the capabilities and limitations of forward model learning agents and their applications to motion-control tasks. Forward model learning agents learn to approximate the environment dynamics to apply planning algorithms for action-selection. While previous work has shown that forward model learning agents can efficiently learn to play simple video games, we extend their applicability to domains with continuous state and action spaces. Our experiments show that such agents are quickly able to learn an approximate model of their environment, which suffices to solve several simple motion-control tasks. Comparisons with deep reinforcement learning further highlight the sample efficiency of forward model learning agents.

Keywords

    Deep Reinforcement Learning, Forward Model Learning, Motion Control Tasks

ASJC Scopus subject areas

Cite this

Forward Model Learning for Motion Control Tasks. / Dockhorn, Alexander; Kruse, Rudolf.
2020 IEEE 10th International Conference on Intelligent Systems, IS 2020 - Proceedings. ed. / Vassil Sgurev; Vladimir Jotsov; Rudolf Kruse; Mincho Hadjiski. Institute of Electrical and Electronics Engineers Inc., 2020. p. 551-556 9199978 (2020 IEEE 10th International Conference on Intelligent Systems, IS 2020 - Proceedings).

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Dockhorn, A & Kruse, R 2020, Forward Model Learning for Motion Control Tasks. in V Sgurev, V Jotsov, R Kruse & M Hadjiski (eds), 2020 IEEE 10th International Conference on Intelligent Systems, IS 2020 - Proceedings., 9199978, 2020 IEEE 10th International Conference on Intelligent Systems, IS 2020 - Proceedings, Institute of Electrical and Electronics Engineers Inc., pp. 551-556, 10th IEEE International Conference on Intelligent Systems, IS 2020, Sofia, Bulgaria, 28 Aug 2020. https://doi.org/10.1109/IS48319.2020.9199978
Dockhorn, A., & Kruse, R. (2020). Forward Model Learning for Motion Control Tasks. In V. Sgurev, V. Jotsov, R. Kruse, & M. Hadjiski (Eds.), 2020 IEEE 10th International Conference on Intelligent Systems, IS 2020 - Proceedings (pp. 551-556). Article 9199978 (2020 IEEE 10th International Conference on Intelligent Systems, IS 2020 - Proceedings). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IS48319.2020.9199978
Dockhorn A, Kruse R. Forward Model Learning for Motion Control Tasks. In Sgurev V, Jotsov V, Kruse R, Hadjiski M, editors, 2020 IEEE 10th International Conference on Intelligent Systems, IS 2020 - Proceedings. Institute of Electrical and Electronics Engineers Inc. 2020. p. 551-556. 9199978. (2020 IEEE 10th International Conference on Intelligent Systems, IS 2020 - Proceedings). doi: 10.1109/IS48319.2020.9199978
Dockhorn, Alexander ; Kruse, Rudolf. / Forward Model Learning for Motion Control Tasks. 2020 IEEE 10th International Conference on Intelligent Systems, IS 2020 - Proceedings. editor / Vassil Sgurev ; Vladimir Jotsov ; Rudolf Kruse ; Mincho Hadjiski. Institute of Electrical and Electronics Engineers Inc., 2020. pp. 551-556 (2020 IEEE 10th International Conference on Intelligent Systems, IS 2020 - Proceedings).
Download
@inproceedings{a198d82e8786443280c7823d8e82fbc0,
title = "Forward Model Learning for Motion Control Tasks",
abstract = "In this work, we study the capabilities and limitations of forward model learning agents and their applications to motion-control tasks. Forward model learning agents learn to approximate the environment dynamics to apply planning algorithms for action-selection. While previous work has shown that forward model learning agents can efficiently learn to play simple video games, we extend their applicability to domains with continuous state and action spaces. Our experiments show that such agents are quickly able to learn an approximate model of their environment, which suffices to solve several simple motion-control tasks. Comparisons with deep reinforcement learning further highlight the sample efficiency of forward model learning agents.",
keywords = "Deep Reinforcement Learning, Forward Model Learning, Motion Control Tasks",
author = "Alexander Dockhorn and Rudolf Kruse",
year = "2020",
month = aug,
doi = "10.1109/IS48319.2020.9199978",
language = "English",
series = "2020 IEEE 10th International Conference on Intelligent Systems, IS 2020 - Proceedings",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "551--556",
editor = "Vassil Sgurev and Vladimir Jotsov and Rudolf Kruse and Mincho Hadjiski",
booktitle = "2020 IEEE 10th International Conference on Intelligent Systems, IS 2020 - Proceedings",
address = "United States",
note = "10th IEEE International Conference on Intelligent Systems, IS 2020 ; Conference date: 28-08-2020 Through 30-08-2020",

}

Download

TY - GEN

T1 - Forward Model Learning for Motion Control Tasks

AU - Dockhorn, Alexander

AU - Kruse, Rudolf

PY - 2020/8

Y1 - 2020/8

N2 - In this work, we study the capabilities and limitations of forward model learning agents and their applications to motion-control tasks. Forward model learning agents learn to approximate the environment dynamics to apply planning algorithms for action-selection. While previous work has shown that forward model learning agents can efficiently learn to play simple video games, we extend their applicability to domains with continuous state and action spaces. Our experiments show that such agents are quickly able to learn an approximate model of their environment, which suffices to solve several simple motion-control tasks. Comparisons with deep reinforcement learning further highlight the sample efficiency of forward model learning agents.

AB - In this work, we study the capabilities and limitations of forward model learning agents and their applications to motion-control tasks. Forward model learning agents learn to approximate the environment dynamics to apply planning algorithms for action-selection. While previous work has shown that forward model learning agents can efficiently learn to play simple video games, we extend their applicability to domains with continuous state and action spaces. Our experiments show that such agents are quickly able to learn an approximate model of their environment, which suffices to solve several simple motion-control tasks. Comparisons with deep reinforcement learning further highlight the sample efficiency of forward model learning agents.

KW - Deep Reinforcement Learning

KW - Forward Model Learning

KW - Motion Control Tasks

UR - http://www.scopus.com/inward/record.url?scp=85092707661&partnerID=8YFLogxK

U2 - 10.1109/IS48319.2020.9199978

DO - 10.1109/IS48319.2020.9199978

M3 - Conference contribution

AN - SCOPUS:85092707661

T3 - 2020 IEEE 10th International Conference on Intelligent Systems, IS 2020 - Proceedings

SP - 551

EP - 556

BT - 2020 IEEE 10th International Conference on Intelligent Systems, IS 2020 - Proceedings

A2 - Sgurev, Vassil

A2 - Jotsov, Vladimir

A2 - Kruse, Rudolf

A2 - Hadjiski, Mincho

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 10th IEEE International Conference on Intelligent Systems, IS 2020

Y2 - 28 August 2020 through 30 August 2020

ER -

By the same author(s)