Crowd of oz: A crowd-powered social robotics system for stress management

Research output: Contribution to journalArticleResearchpeer review

Authors

  • Tahir Abbas
  • Vassilis Javed Khan
  • Ujwal Gadiraju
  • Emilia Barakova
  • Panos Markopoulos

Research Organisations

External Research Organisations

  • Eindhoven University of Technology (TU/e)
  • Mirpur University of Science and Technology (MUST)
View graph of relations

Details

Original languageEnglish
Article number569
JournalSensors (Switzerland)
Volume20
Issue number2
Publication statusPublished - 20 Jan 2020

Abstract

Coping with stress is crucial for a healthy lifestyle. In the past, a great deal of research has been conducted to use socially assistive robots as a therapy to alleviate stress and anxiety related problems. However, building a fully autonomous social robot which can deliver psycho-therapeutic solutions is a very challenging endeavor due to limitations in artificial intelligence (AI). To overcome AI’s limitations, researchers have previously introduced crowdsourcing-based teleoperation methods, which summon the crowd’s input to control a robot’s functions. However, in the context of robotics, such methods have only been used to support the object manipulation, navigational, and training tasks. It is not yet known how to leverage real-time crowdsourcing (RTC) to process complex therapeutic conversational tasks for social robotics. To fill this gap, we developed Crowd of Oz (CoZ), an open-source system that allows Softbank’s Pepper robot to support such conversational tasks. To demonstrate the potential implications of this crowd-powered approach, we investigated how effectively, crowd workers recruited in real-time can teleoperate the robot’s speech, in situations when the robot needs to act as a life coach. We systematically varied the number of workers who simultaneously handle the speech of the robot (N = 1, 2, 4, 8) and investigated the concomitant effects for enabling RTC for social robotics. Additionally, we present Pavilion, a novel and open-source algorithm for managing the workers’ queue so that a required number of workers are engaged or waiting. Based on our findings, we discuss salient parameters that such crowd-powered systems must adhere to, so as to enhance their performance in response latency and dialogue quality.

Keywords

    Coaching, Crowdsourcing, Human computation, Real-time crowd-powered systems, Social conversation, Social robotics, Stress

ASJC Scopus subject areas

Sustainable Development Goals

Cite this

Crowd of oz: A crowd-powered social robotics system for stress management. / Abbas, Tahir; Khan, Vassilis Javed; Gadiraju, Ujwal et al.
In: Sensors (Switzerland), Vol. 20, No. 2, 569, 20.01.2020.

Research output: Contribution to journalArticleResearchpeer review

Abbas, T, Khan, VJ, Gadiraju, U, Barakova, E & Markopoulos, P 2020, 'Crowd of oz: A crowd-powered social robotics system for stress management', Sensors (Switzerland), vol. 20, no. 2, 569. https://doi.org/10.3390/s20020569
Abbas, T., Khan, V. J., Gadiraju, U., Barakova, E., & Markopoulos, P. (2020). Crowd of oz: A crowd-powered social robotics system for stress management. Sensors (Switzerland), 20(2), Article 569. https://doi.org/10.3390/s20020569
Abbas T, Khan VJ, Gadiraju U, Barakova E, Markopoulos P. Crowd of oz: A crowd-powered social robotics system for stress management. Sensors (Switzerland). 2020 Jan 20;20(2):569. doi: 10.3390/s20020569
Abbas, Tahir ; Khan, Vassilis Javed ; Gadiraju, Ujwal et al. / Crowd of oz : A crowd-powered social robotics system for stress management. In: Sensors (Switzerland). 2020 ; Vol. 20, No. 2.
Download
@article{fcccd736091c410db8261ca6809d1e11,
title = "Crowd of oz: A crowd-powered social robotics system for stress management",
abstract = "Coping with stress is crucial for a healthy lifestyle. In the past, a great deal of research has been conducted to use socially assistive robots as a therapy to alleviate stress and anxiety related problems. However, building a fully autonomous social robot which can deliver psycho-therapeutic solutions is a very challenging endeavor due to limitations in artificial intelligence (AI). To overcome AI{\textquoteright}s limitations, researchers have previously introduced crowdsourcing-based teleoperation methods, which summon the crowd{\textquoteright}s input to control a robot{\textquoteright}s functions. However, in the context of robotics, such methods have only been used to support the object manipulation, navigational, and training tasks. It is not yet known how to leverage real-time crowdsourcing (RTC) to process complex therapeutic conversational tasks for social robotics. To fill this gap, we developed Crowd of Oz (CoZ), an open-source system that allows Softbank{\textquoteright}s Pepper robot to support such conversational tasks. To demonstrate the potential implications of this crowd-powered approach, we investigated how effectively, crowd workers recruited in real-time can teleoperate the robot{\textquoteright}s speech, in situations when the robot needs to act as a life coach. We systematically varied the number of workers who simultaneously handle the speech of the robot (N = 1, 2, 4, 8) and investigated the concomitant effects for enabling RTC for social robotics. Additionally, we present Pavilion, a novel and open-source algorithm for managing the workers{\textquoteright} queue so that a required number of workers are engaged or waiting. Based on our findings, we discuss salient parameters that such crowd-powered systems must adhere to, so as to enhance their performance in response latency and dialogue quality.",
keywords = "Coaching, Crowdsourcing, Human computation, Real-time crowd-powered systems, Social conversation, Social robotics, Stress",
author = "Tahir Abbas and Khan, {Vassilis Javed} and Ujwal Gadiraju and Emilia Barakova and Panos Markopoulos",
note = "Funding Information: This work was supported by Higher Education Commission of Pakistan (HEC) in cooperation with Mirpur University of Science & Technology (MUST), Mirpur (AJK)-10250, Pakistan under grant number: 611-19/P.D/2017. We extend our gratitude to the contributing workers on Amazon Mechanical Turk and the actress Carla who improvised dialogues with the CoZ.",
year = "2020",
month = jan,
day = "20",
doi = "10.3390/s20020569",
language = "English",
volume = "20",
journal = "Sensors (Switzerland)",
issn = "1424-8220",
publisher = "Multidisciplinary Digital Publishing Institute",
number = "2",

}

Download

TY - JOUR

T1 - Crowd of oz

T2 - A crowd-powered social robotics system for stress management

AU - Abbas, Tahir

AU - Khan, Vassilis Javed

AU - Gadiraju, Ujwal

AU - Barakova, Emilia

AU - Markopoulos, Panos

N1 - Funding Information: This work was supported by Higher Education Commission of Pakistan (HEC) in cooperation with Mirpur University of Science & Technology (MUST), Mirpur (AJK)-10250, Pakistan under grant number: 611-19/P.D/2017. We extend our gratitude to the contributing workers on Amazon Mechanical Turk and the actress Carla who improvised dialogues with the CoZ.

PY - 2020/1/20

Y1 - 2020/1/20

N2 - Coping with stress is crucial for a healthy lifestyle. In the past, a great deal of research has been conducted to use socially assistive robots as a therapy to alleviate stress and anxiety related problems. However, building a fully autonomous social robot which can deliver psycho-therapeutic solutions is a very challenging endeavor due to limitations in artificial intelligence (AI). To overcome AI’s limitations, researchers have previously introduced crowdsourcing-based teleoperation methods, which summon the crowd’s input to control a robot’s functions. However, in the context of robotics, such methods have only been used to support the object manipulation, navigational, and training tasks. It is not yet known how to leverage real-time crowdsourcing (RTC) to process complex therapeutic conversational tasks for social robotics. To fill this gap, we developed Crowd of Oz (CoZ), an open-source system that allows Softbank’s Pepper robot to support such conversational tasks. To demonstrate the potential implications of this crowd-powered approach, we investigated how effectively, crowd workers recruited in real-time can teleoperate the robot’s speech, in situations when the robot needs to act as a life coach. We systematically varied the number of workers who simultaneously handle the speech of the robot (N = 1, 2, 4, 8) and investigated the concomitant effects for enabling RTC for social robotics. Additionally, we present Pavilion, a novel and open-source algorithm for managing the workers’ queue so that a required number of workers are engaged or waiting. Based on our findings, we discuss salient parameters that such crowd-powered systems must adhere to, so as to enhance their performance in response latency and dialogue quality.

AB - Coping with stress is crucial for a healthy lifestyle. In the past, a great deal of research has been conducted to use socially assistive robots as a therapy to alleviate stress and anxiety related problems. However, building a fully autonomous social robot which can deliver psycho-therapeutic solutions is a very challenging endeavor due to limitations in artificial intelligence (AI). To overcome AI’s limitations, researchers have previously introduced crowdsourcing-based teleoperation methods, which summon the crowd’s input to control a robot’s functions. However, in the context of robotics, such methods have only been used to support the object manipulation, navigational, and training tasks. It is not yet known how to leverage real-time crowdsourcing (RTC) to process complex therapeutic conversational tasks for social robotics. To fill this gap, we developed Crowd of Oz (CoZ), an open-source system that allows Softbank’s Pepper robot to support such conversational tasks. To demonstrate the potential implications of this crowd-powered approach, we investigated how effectively, crowd workers recruited in real-time can teleoperate the robot’s speech, in situations when the robot needs to act as a life coach. We systematically varied the number of workers who simultaneously handle the speech of the robot (N = 1, 2, 4, 8) and investigated the concomitant effects for enabling RTC for social robotics. Additionally, we present Pavilion, a novel and open-source algorithm for managing the workers’ queue so that a required number of workers are engaged or waiting. Based on our findings, we discuss salient parameters that such crowd-powered systems must adhere to, so as to enhance their performance in response latency and dialogue quality.

KW - Coaching

KW - Crowdsourcing

KW - Human computation

KW - Real-time crowd-powered systems

KW - Social conversation

KW - Social robotics

KW - Stress

UR - http://www.scopus.com/inward/record.url?scp=85078321553&partnerID=8YFLogxK

U2 - 10.3390/s20020569

DO - 10.3390/s20020569

M3 - Article

C2 - 31968650

AN - SCOPUS:85078321553

VL - 20

JO - Sensors (Switzerland)

JF - Sensors (Switzerland)

SN - 1424-8220

IS - 2

M1 - 569

ER -