A robotic home assistant with memory aid functionality

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

  • Iris Wieser
  • Sibel Toprak
  • Andreas Grenzing
  • Tobias Hinz
  • Sayantan Auddy
  • Ethem Can Karaoğuz
  • Abhilash Chandran
  • Melanie Remmels
  • Ahmed El Shinawi
  • Josip Josifovski
  • Leena Chennuru Vankadara
  • Faiz Ul Wahab
  • Alireza M. Bahnemiri
  • Debasish Sahu
  • Stefan Heinrich
  • Nicolás Navarro-Guerrero
  • Erik Strahl
  • Johannes Twiefel
  • Stefan Wermter

External Research Organisations

  • Universität Hamburg
View graph of relations

Details

Original languageEnglish
Title of host publicationAdvances in Artificial Intelligence - 39th Annual German Conference on AI, KI 2016, Proceedings
EditorsMalte Helmert, Franz Wotawa, Gerhard Friedrich
PublisherSpringer Verlag
Pages102-115
Number of pages14
ISBN (print)9783319460727
Publication statusPublished - 2016
Externally publishedYes
Event39th German Conference on Artificial Intelligence, KI 2016 - Klagenfurt, Austria
Duration: 26 Sept 201630 Sept 2016

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume9904 LNAI
ISSN (Print)0302-9743
ISSN (electronic)1611-3349

Abstract

We present the robotic system IRMA (Interactive Robotic Memory Aid) that assists humans in their search for misplaced belongings within a natural home-like environment. Our stand-alone system integrates state-of-the-art approaches in a novel manner to achieve a seamless and intuitive human-robot interaction. IRMA directs its gaze toward the speaker and understands the person’s verbal instructions independent of specific grammatical constructions. It determines the positions of relevant objects and navigates collision-free within the environment. In addition, IRMA produces natural language descriptions for the objects’ positions by using furniture as reference points. To evaluate IRMA’s usefulness, a user study with 20 participants has been conducted. IRMA achieves an overall user satisfaction score of 4.05 and a perceived accuracy rating of 4.15 on a scale from 1–5 with 5 being the best.

Keywords

    Human-robot interaction, Memory service system, Natural language understanding, Object detection, Person detection, Robotic home assistant, Social robotics, Speech recognition

ASJC Scopus subject areas

Cite this

A robotic home assistant with memory aid functionality. / Wieser, Iris; Toprak, Sibel; Grenzing, Andreas et al.
Advances in Artificial Intelligence - 39th Annual German Conference on AI, KI 2016, Proceedings. ed. / Malte Helmert; Franz Wotawa; Gerhard Friedrich. Springer Verlag, 2016. p. 102-115 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9904 LNAI).

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Wieser, I, Toprak, S, Grenzing, A, Hinz, T, Auddy, S, Can Karaoğuz, E, Chandran, A, Remmels, M, El Shinawi, A, Josifovski, J, Vankadara, LC, Ul Wahab, F, Bahnemiri, AM, Sahu, D, Heinrich, S, Navarro-Guerrero, N, Strahl, E, Twiefel, J & Wermter, S 2016, A robotic home assistant with memory aid functionality. in M Helmert, F Wotawa & G Friedrich (eds), Advances in Artificial Intelligence - 39th Annual German Conference on AI, KI 2016, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 9904 LNAI, Springer Verlag, pp. 102-115, 39th German Conference on Artificial Intelligence, KI 2016, Klagenfurt, Austria, 26 Sept 2016. https://doi.org/10.1007/978-3-319-46073-4_8
Wieser, I., Toprak, S., Grenzing, A., Hinz, T., Auddy, S., Can Karaoğuz, E., Chandran, A., Remmels, M., El Shinawi, A., Josifovski, J., Vankadara, L. C., Ul Wahab, F., Bahnemiri, A. M., Sahu, D., Heinrich, S., Navarro-Guerrero, N., Strahl, E., Twiefel, J., & Wermter, S. (2016). A robotic home assistant with memory aid functionality. In M. Helmert, F. Wotawa, & G. Friedrich (Eds.), Advances in Artificial Intelligence - 39th Annual German Conference on AI, KI 2016, Proceedings (pp. 102-115). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9904 LNAI). Springer Verlag. https://doi.org/10.1007/978-3-319-46073-4_8
Wieser I, Toprak S, Grenzing A, Hinz T, Auddy S, Can Karaoğuz E et al. A robotic home assistant with memory aid functionality. In Helmert M, Wotawa F, Friedrich G, editors, Advances in Artificial Intelligence - 39th Annual German Conference on AI, KI 2016, Proceedings. Springer Verlag. 2016. p. 102-115. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-319-46073-4_8
Wieser, Iris ; Toprak, Sibel ; Grenzing, Andreas et al. / A robotic home assistant with memory aid functionality. Advances in Artificial Intelligence - 39th Annual German Conference on AI, KI 2016, Proceedings. editor / Malte Helmert ; Franz Wotawa ; Gerhard Friedrich. Springer Verlag, 2016. pp. 102-115 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
Download
@inproceedings{9dc1c8f12b434c599d9e23959c0fd9ef,
title = "A robotic home assistant with memory aid functionality",
abstract = "We present the robotic system IRMA (Interactive Robotic Memory Aid) that assists humans in their search for misplaced belongings within a natural home-like environment. Our stand-alone system integrates state-of-the-art approaches in a novel manner to achieve a seamless and intuitive human-robot interaction. IRMA directs its gaze toward the speaker and understands the person{\textquoteright}s verbal instructions independent of specific grammatical constructions. It determines the positions of relevant objects and navigates collision-free within the environment. In addition, IRMA produces natural language descriptions for the objects{\textquoteright} positions by using furniture as reference points. To evaluate IRMA{\textquoteright}s usefulness, a user study with 20 participants has been conducted. IRMA achieves an overall user satisfaction score of 4.05 and a perceived accuracy rating of 4.15 on a scale from 1–5 with 5 being the best.",
keywords = "Human-robot interaction, Memory service system, Natural language understanding, Object detection, Person detection, Robotic home assistant, Social robotics, Speech recognition",
author = "Iris Wieser and Sibel Toprak and Andreas Grenzing and Tobias Hinz and Sayantan Auddy and {Can Karaoğuz}, Ethem and Abhilash Chandran and Melanie Remmels and {El Shinawi}, Ahmed and Josip Josifovski and Vankadara, {Leena Chennuru} and {Ul Wahab}, Faiz and Bahnemiri, {Alireza M.} and Debasish Sahu and Stefan Heinrich and Nicol{\'a}s Navarro-Guerrero and Erik Strahl and Johannes Twiefel and Stefan Wermter",
note = "Publisher Copyright: {\textcopyright} Springer International Publishing AG 2016.; 39th German Conference on Artificial Intelligence, KI 2016 ; Conference date: 26-09-2016 Through 30-09-2016",
year = "2016",
doi = "10.1007/978-3-319-46073-4_8",
language = "English",
isbn = "9783319460727",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
pages = "102--115",
editor = "Malte Helmert and Franz Wotawa and Gerhard Friedrich",
booktitle = "Advances in Artificial Intelligence - 39th Annual German Conference on AI, KI 2016, Proceedings",
address = "Germany",

}

Download

TY - GEN

T1 - A robotic home assistant with memory aid functionality

AU - Wieser, Iris

AU - Toprak, Sibel

AU - Grenzing, Andreas

AU - Hinz, Tobias

AU - Auddy, Sayantan

AU - Can Karaoğuz, Ethem

AU - Chandran, Abhilash

AU - Remmels, Melanie

AU - El Shinawi, Ahmed

AU - Josifovski, Josip

AU - Vankadara, Leena Chennuru

AU - Ul Wahab, Faiz

AU - Bahnemiri, Alireza M.

AU - Sahu, Debasish

AU - Heinrich, Stefan

AU - Navarro-Guerrero, Nicolás

AU - Strahl, Erik

AU - Twiefel, Johannes

AU - Wermter, Stefan

N1 - Publisher Copyright: © Springer International Publishing AG 2016.

PY - 2016

Y1 - 2016

N2 - We present the robotic system IRMA (Interactive Robotic Memory Aid) that assists humans in their search for misplaced belongings within a natural home-like environment. Our stand-alone system integrates state-of-the-art approaches in a novel manner to achieve a seamless and intuitive human-robot interaction. IRMA directs its gaze toward the speaker and understands the person’s verbal instructions independent of specific grammatical constructions. It determines the positions of relevant objects and navigates collision-free within the environment. In addition, IRMA produces natural language descriptions for the objects’ positions by using furniture as reference points. To evaluate IRMA’s usefulness, a user study with 20 participants has been conducted. IRMA achieves an overall user satisfaction score of 4.05 and a perceived accuracy rating of 4.15 on a scale from 1–5 with 5 being the best.

AB - We present the robotic system IRMA (Interactive Robotic Memory Aid) that assists humans in their search for misplaced belongings within a natural home-like environment. Our stand-alone system integrates state-of-the-art approaches in a novel manner to achieve a seamless and intuitive human-robot interaction. IRMA directs its gaze toward the speaker and understands the person’s verbal instructions independent of specific grammatical constructions. It determines the positions of relevant objects and navigates collision-free within the environment. In addition, IRMA produces natural language descriptions for the objects’ positions by using furniture as reference points. To evaluate IRMA’s usefulness, a user study with 20 participants has been conducted. IRMA achieves an overall user satisfaction score of 4.05 and a perceived accuracy rating of 4.15 on a scale from 1–5 with 5 being the best.

KW - Human-robot interaction

KW - Memory service system

KW - Natural language understanding

KW - Object detection

KW - Person detection

KW - Robotic home assistant

KW - Social robotics

KW - Speech recognition

UR - http://www.scopus.com/inward/record.url?scp=84988651952&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-46073-4_8

DO - 10.1007/978-3-319-46073-4_8

M3 - Conference contribution

AN - SCOPUS:84988651952

SN - 9783319460727

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 102

EP - 115

BT - Advances in Artificial Intelligence - 39th Annual German Conference on AI, KI 2016, Proceedings

A2 - Helmert, Malte

A2 - Wotawa, Franz

A2 - Friedrich, Gerhard

PB - Springer Verlag

T2 - 39th German Conference on Artificial Intelligence, KI 2016

Y2 - 26 September 2016 through 30 September 2016

ER -

By the same author(s)