Door opening and traversal with an industrial cartesian impedance controlled mobile robot

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Autorschaft

  • Marvin Stüde
  • Kathrin Nülle
  • Svenja Tappe
  • Tobias Ortmaier

Organisationseinheiten

Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Titel des Sammelwerks2019 International Conference on Robotics and Automation, ICRA 2019
Herausgeber (Verlag)Institute of Electrical and Electronics Engineers Inc.
Seiten966-972
Seitenumfang7
ISBN (elektronisch)978-1-5386-6027-0
ISBN (Print)978-1-5386-8176-3
PublikationsstatusVeröffentlicht - Mai 2019
Veranstaltung2019 International Conference on Robotics and Automation, ICRA 2019 - Montreal, Kanada
Dauer: 20 Mai 201924 Mai 2019

Publikationsreihe

NameProceedings - IEEE International Conference on Robotics and Automation
ISSN (Print)1050-4729

Abstract

This paper presents a holistic approach for door opening with a cartesian impedance controlled mobile robot, a KUICA KMR iiwa. Based on a given map of the environment, the robot autonomously detects the door handle, opens doors and traverses doorways without knowledge of a door model or the door's geometry. The door handle detection uses a convolutional neural network (CNN)-based architecture to obtain the handle's bounding box in a RGB image that works robustly for various handle shapes and colors. We achieve a detection rate of 100% for an evaluation set of 38 different door handles, by always selecting for highest confidence score. Registered depth data segmentation defines the door plane to construct a handle coordinate frame. We introduce a control structure based on the task frame formalism that uses the handle frame for reference in an outer loop for the manipulator's impedance controller. It runs in soft real-time on an external computer with approximately 20 Hz since access to inner controller loops is not available for the KMR iiwa. With the approach proposed in this paper, the robot successfully opened and traversed for 22 out of 25 trials at five different doors.

ASJC Scopus Sachgebiete

Zitieren

Door opening and traversal with an industrial cartesian impedance controlled mobile robot. / Stüde, Marvin; Nülle, Kathrin; Tappe, Svenja et al.
2019 International Conference on Robotics and Automation, ICRA 2019. Institute of Electrical and Electronics Engineers Inc., 2019. S. 966-972 8793866 (Proceedings - IEEE International Conference on Robotics and Automation).

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Stüde, M, Nülle, K, Tappe, S & Ortmaier, T 2019, Door opening and traversal with an industrial cartesian impedance controlled mobile robot. in 2019 International Conference on Robotics and Automation, ICRA 2019., 8793866, Proceedings - IEEE International Conference on Robotics and Automation, Institute of Electrical and Electronics Engineers Inc., S. 966-972, 2019 International Conference on Robotics and Automation, ICRA 2019, Montreal, Kanada, 20 Mai 2019. https://doi.org/10.1109/ICRA.2019.8793866
Stüde, M., Nülle, K., Tappe, S., & Ortmaier, T. (2019). Door opening and traversal with an industrial cartesian impedance controlled mobile robot. In 2019 International Conference on Robotics and Automation, ICRA 2019 (S. 966-972). Artikel 8793866 (Proceedings - IEEE International Conference on Robotics and Automation). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICRA.2019.8793866
Stüde M, Nülle K, Tappe S, Ortmaier T. Door opening and traversal with an industrial cartesian impedance controlled mobile robot. in 2019 International Conference on Robotics and Automation, ICRA 2019. Institute of Electrical and Electronics Engineers Inc. 2019. S. 966-972. 8793866. (Proceedings - IEEE International Conference on Robotics and Automation). doi: 10.1109/ICRA.2019.8793866
Stüde, Marvin ; Nülle, Kathrin ; Tappe, Svenja et al. / Door opening and traversal with an industrial cartesian impedance controlled mobile robot. 2019 International Conference on Robotics and Automation, ICRA 2019. Institute of Electrical and Electronics Engineers Inc., 2019. S. 966-972 (Proceedings - IEEE International Conference on Robotics and Automation).
Download
@inproceedings{b12cac2f1c8a4422b92dc3e2fa81262c,
title = "Door opening and traversal with an industrial cartesian impedance controlled mobile robot",
abstract = "This paper presents a holistic approach for door opening with a cartesian impedance controlled mobile robot, a KUICA KMR iiwa. Based on a given map of the environment, the robot autonomously detects the door handle, opens doors and traverses doorways without knowledge of a door model or the door's geometry. The door handle detection uses a convolutional neural network (CNN)-based architecture to obtain the handle's bounding box in a RGB image that works robustly for various handle shapes and colors. We achieve a detection rate of 100% for an evaluation set of 38 different door handles, by always selecting for highest confidence score. Registered depth data segmentation defines the door plane to construct a handle coordinate frame. We introduce a control structure based on the task frame formalism that uses the handle frame for reference in an outer loop for the manipulator's impedance controller. It runs in soft real-time on an external computer with approximately 20 Hz since access to inner controller loops is not available for the KMR iiwa. With the approach proposed in this paper, the robot successfully opened and traversed for 22 out of 25 trials at five different doors.",
author = "Marvin St{\"u}de and Kathrin N{\"u}lle and Svenja Tappe and Tobias Ortmaier",
year = "2019",
month = may,
doi = "10.1109/ICRA.2019.8793866",
language = "English",
isbn = "978-1-5386-8176-3",
series = "Proceedings - IEEE International Conference on Robotics and Automation",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "966--972",
booktitle = "2019 International Conference on Robotics and Automation, ICRA 2019",
address = "United States",
note = "2019 International Conference on Robotics and Automation, ICRA 2019 ; Conference date: 20-05-2019 Through 24-05-2019",

}

Download

TY - GEN

T1 - Door opening and traversal with an industrial cartesian impedance controlled mobile robot

AU - Stüde, Marvin

AU - Nülle, Kathrin

AU - Tappe, Svenja

AU - Ortmaier, Tobias

PY - 2019/5

Y1 - 2019/5

N2 - This paper presents a holistic approach for door opening with a cartesian impedance controlled mobile robot, a KUICA KMR iiwa. Based on a given map of the environment, the robot autonomously detects the door handle, opens doors and traverses doorways without knowledge of a door model or the door's geometry. The door handle detection uses a convolutional neural network (CNN)-based architecture to obtain the handle's bounding box in a RGB image that works robustly for various handle shapes and colors. We achieve a detection rate of 100% for an evaluation set of 38 different door handles, by always selecting for highest confidence score. Registered depth data segmentation defines the door plane to construct a handle coordinate frame. We introduce a control structure based on the task frame formalism that uses the handle frame for reference in an outer loop for the manipulator's impedance controller. It runs in soft real-time on an external computer with approximately 20 Hz since access to inner controller loops is not available for the KMR iiwa. With the approach proposed in this paper, the robot successfully opened and traversed for 22 out of 25 trials at five different doors.

AB - This paper presents a holistic approach for door opening with a cartesian impedance controlled mobile robot, a KUICA KMR iiwa. Based on a given map of the environment, the robot autonomously detects the door handle, opens doors and traverses doorways without knowledge of a door model or the door's geometry. The door handle detection uses a convolutional neural network (CNN)-based architecture to obtain the handle's bounding box in a RGB image that works robustly for various handle shapes and colors. We achieve a detection rate of 100% for an evaluation set of 38 different door handles, by always selecting for highest confidence score. Registered depth data segmentation defines the door plane to construct a handle coordinate frame. We introduce a control structure based on the task frame formalism that uses the handle frame for reference in an outer loop for the manipulator's impedance controller. It runs in soft real-time on an external computer with approximately 20 Hz since access to inner controller loops is not available for the KMR iiwa. With the approach proposed in this paper, the robot successfully opened and traversed for 22 out of 25 trials at five different doors.

UR - http://www.scopus.com/inward/record.url?scp=85071443533&partnerID=8YFLogxK

U2 - 10.1109/ICRA.2019.8793866

DO - 10.1109/ICRA.2019.8793866

M3 - Conference contribution

AN - SCOPUS:85071443533

SN - 978-1-5386-8176-3

T3 - Proceedings - IEEE International Conference on Robotics and Automation

SP - 966

EP - 972

BT - 2019 International Conference on Robotics and Automation, ICRA 2019

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2019 International Conference on Robotics and Automation, ICRA 2019

Y2 - 20 May 2019 through 24 May 2019

ER -