Real-world reinforcement learning for autonomous humanoid robot docking

Publikation: Beitrag in FachzeitschriftArtikelForschungPeer-Review

Autorschaft

Externe Organisationen

  • Universität Hamburg
Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Seiten (von - bis)1400-1407
Seitenumfang8
FachzeitschriftRobotics and autonomous systems
Jahrgang60
Ausgabenummer11
PublikationsstatusVeröffentlicht - Nov. 2012
Extern publiziertJa

Abstract

Reinforcement learning (RL) is a biologically supported learning paradigm, which allows an agent to learn through experience acquired by interaction with its environment. Its potential to learn complex action sequences has been proven for a variety of problems, such as navigation tasks. However, the interactive randomized exploration of the state space, common in reinforcement learning, makes it difficult to be used in real-world scenarios. In this work we describe a novel real-world reinforcement learning method. It uses a supervised reinforcement learning approach combined with Gaussian distributed state activation. We successfully tested this method in two real scenarios of humanoid robot navigation: first, backward movements for docking at a charging station and second, forward movements to prepare grasping. Our approach reduces the required learning steps by more than an order of magnitude, and it is robust and easy to be integrated into conventional RL techniques.

ASJC Scopus Sachgebiete

Zitieren

Real-world reinforcement learning for autonomous humanoid robot docking. / Navarro-Guerrero, Nicolás; Weber, Cornelius; Schroeter, Pascal et al.
in: Robotics and autonomous systems, Jahrgang 60, Nr. 11, 11.2012, S. 1400-1407.

Publikation: Beitrag in FachzeitschriftArtikelForschungPeer-Review

Navarro-Guerrero N, Weber C, Schroeter P, Wermter S. Real-world reinforcement learning for autonomous humanoid robot docking. Robotics and autonomous systems. 2012 Nov;60(11):1400-1407. doi: 10.1016/j.robot.2012.05.019
Navarro-Guerrero, Nicolás ; Weber, Cornelius ; Schroeter, Pascal et al. / Real-world reinforcement learning for autonomous humanoid robot docking. in: Robotics and autonomous systems. 2012 ; Jahrgang 60, Nr. 11. S. 1400-1407.
Download
@article{3ba4a56d1ead4f08af874cf4e02d9e34,
title = "Real-world reinforcement learning for autonomous humanoid robot docking",
abstract = "Reinforcement learning (RL) is a biologically supported learning paradigm, which allows an agent to learn through experience acquired by interaction with its environment. Its potential to learn complex action sequences has been proven for a variety of problems, such as navigation tasks. However, the interactive randomized exploration of the state space, common in reinforcement learning, makes it difficult to be used in real-world scenarios. In this work we describe a novel real-world reinforcement learning method. It uses a supervised reinforcement learning approach combined with Gaussian distributed state activation. We successfully tested this method in two real scenarios of humanoid robot navigation: first, backward movements for docking at a charging station and second, forward movements to prepare grasping. Our approach reduces the required learning steps by more than an order of magnitude, and it is robust and easy to be integrated into conventional RL techniques.",
keywords = "Autonomous docking, Humanoid robots, Real-world, Reinforcement learning, SARSA",
author = "Nicol{\'a}s Navarro-Guerrero and Cornelius Weber and Pascal Schroeter and Stefan Wermter",
year = "2012",
month = nov,
doi = "10.1016/j.robot.2012.05.019",
language = "English",
volume = "60",
pages = "1400--1407",
journal = "Robotics and autonomous systems",
issn = "0921-8890",
publisher = "North-Holland Publ Co",
number = "11",

}

Download

TY - JOUR

T1 - Real-world reinforcement learning for autonomous humanoid robot docking

AU - Navarro-Guerrero, Nicolás

AU - Weber, Cornelius

AU - Schroeter, Pascal

AU - Wermter, Stefan

PY - 2012/11

Y1 - 2012/11

N2 - Reinforcement learning (RL) is a biologically supported learning paradigm, which allows an agent to learn through experience acquired by interaction with its environment. Its potential to learn complex action sequences has been proven for a variety of problems, such as navigation tasks. However, the interactive randomized exploration of the state space, common in reinforcement learning, makes it difficult to be used in real-world scenarios. In this work we describe a novel real-world reinforcement learning method. It uses a supervised reinforcement learning approach combined with Gaussian distributed state activation. We successfully tested this method in two real scenarios of humanoid robot navigation: first, backward movements for docking at a charging station and second, forward movements to prepare grasping. Our approach reduces the required learning steps by more than an order of magnitude, and it is robust and easy to be integrated into conventional RL techniques.

AB - Reinforcement learning (RL) is a biologically supported learning paradigm, which allows an agent to learn through experience acquired by interaction with its environment. Its potential to learn complex action sequences has been proven for a variety of problems, such as navigation tasks. However, the interactive randomized exploration of the state space, common in reinforcement learning, makes it difficult to be used in real-world scenarios. In this work we describe a novel real-world reinforcement learning method. It uses a supervised reinforcement learning approach combined with Gaussian distributed state activation. We successfully tested this method in two real scenarios of humanoid robot navigation: first, backward movements for docking at a charging station and second, forward movements to prepare grasping. Our approach reduces the required learning steps by more than an order of magnitude, and it is robust and easy to be integrated into conventional RL techniques.

KW - Autonomous docking

KW - Humanoid robots

KW - Real-world

KW - Reinforcement learning

KW - SARSA

UR - http://www.scopus.com/inward/record.url?scp=84867874785&partnerID=8YFLogxK

U2 - 10.1016/j.robot.2012.05.019

DO - 10.1016/j.robot.2012.05.019

M3 - Article

AN - SCOPUS:84867874785

VL - 60

SP - 1400

EP - 1407

JO - Robotics and autonomous systems

JF - Robotics and autonomous systems

SN - 0921-8890

IS - 11

ER -

Von denselben Autoren