Understanding worker moods and reactions to rejection in crowdsourcing

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Autoren

  • Ujwal Kumar Gadiraju
  • Gianluca Demartini

Organisationseinheiten

Externe Organisationen

  • University of Queensland
Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Titel des SammelwerksHT 2019
UntertitelProceedings of the 30th ACM Conference on Hypertext and Social Media
ErscheinungsortNew York
Seiten211-220
Seitenumfang10
ISBN (elektronisch)9781450368858
PublikationsstatusVeröffentlicht - 12 Sept. 2019
Veranstaltung30th ACM Conference on Hypertext and Social Media, HT 2019 - Hof, Deutschland
Dauer: 17 Sept. 201920 Sept. 2019

Abstract

Requesters on crowdsourcing platforms typically exercise the power to decide the fate of tasks completed by crowd workers. Rejecting work has a direct impact on workers; (i) they may not be rewarded for the work completed and for their effort that has been exerted, and (ii) rejection affects worker reputation and may limit their access to future work opportunities. This paper presents a comprehensive study that aims to understand worker moods and how workers react to rejections in microtask crowdsourcing. We experimentally investigate the effect of the mood of workers on their performance, and the interaction of their moods with their reactions to rejection. Finally, we explore techniques such as presenting social comparative explanations to foster positive reactions to rejection. We found that workers in pleasant moods significantly outperform those in unpleasant moods. Workers whose work is rejected due to narrowly failing pre-screening tests exhibited the most negative emotional responses.

ASJC Scopus Sachgebiete

Zitieren

Understanding worker moods and reactions to rejection in crowdsourcing. / Gadiraju, Ujwal Kumar; Demartini, Gianluca.
HT 2019: Proceedings of the 30th ACM Conference on Hypertext and Social Media. New York, 2019. S. 211-220.

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Gadiraju, UK & Demartini, G 2019, Understanding worker moods and reactions to rejection in crowdsourcing. in HT 2019: Proceedings of the 30th ACM Conference on Hypertext and Social Media. New York, S. 211-220, 30th ACM Conference on Hypertext and Social Media, HT 2019, Hof, Deutschland, 17 Sept. 2019. https://doi.org/10.1145/3342220.3343644
Gadiraju, U. K., & Demartini, G. (2019). Understanding worker moods and reactions to rejection in crowdsourcing. In HT 2019: Proceedings of the 30th ACM Conference on Hypertext and Social Media (S. 211-220). https://doi.org/10.1145/3342220.3343644
Gadiraju UK, Demartini G. Understanding worker moods and reactions to rejection in crowdsourcing. in HT 2019: Proceedings of the 30th ACM Conference on Hypertext and Social Media. New York. 2019. S. 211-220 doi: 10.1145/3342220.3343644
Gadiraju, Ujwal Kumar ; Demartini, Gianluca. / Understanding worker moods and reactions to rejection in crowdsourcing. HT 2019: Proceedings of the 30th ACM Conference on Hypertext and Social Media. New York, 2019. S. 211-220
Download
@inproceedings{d52c1d42adf14b769a37a99af0b2c765,
title = "Understanding worker moods and reactions to rejection in crowdsourcing",
abstract = "Requesters on crowdsourcing platforms typically exercise the power to decide the fate of tasks completed by crowd workers. Rejecting work has a direct impact on workers; (i) they may not be rewarded for the work completed and for their effort that has been exerted, and (ii) rejection affects worker reputation and may limit their access to future work opportunities. This paper presents a comprehensive study that aims to understand worker moods and how workers react to rejections in microtask crowdsourcing. We experimentally investigate the effect of the mood of workers on their performance, and the interaction of their moods with their reactions to rejection. Finally, we explore techniques such as presenting social comparative explanations to foster positive reactions to rejection. We found that workers in pleasant moods significantly outperform those in unpleasant moods. Workers whose work is rejected due to narrowly failing pre-screening tests exhibited the most negative emotional responses.",
author = "Gadiraju, {Ujwal Kumar} and Gianluca Demartini",
note = "Funding information: We thank all the workers who participated in our experiments. This research has been supported in part by the Erasmus+ project DISKOW (grant no. 60171990), and EU's H2020 (grant no. 732328).; 30th ACM Conference on Hypertext and Social Media, HT 2019 ; Conference date: 17-09-2019 Through 20-09-2019",
year = "2019",
month = sep,
day = "12",
doi = "10.1145/3342220.3343644",
language = "English",
pages = "211--220",
booktitle = "HT 2019",

}

Download

TY - GEN

T1 - Understanding worker moods and reactions to rejection in crowdsourcing

AU - Gadiraju, Ujwal Kumar

AU - Demartini, Gianluca

N1 - Funding information: We thank all the workers who participated in our experiments. This research has been supported in part by the Erasmus+ project DISKOW (grant no. 60171990), and EU's H2020 (grant no. 732328).

PY - 2019/9/12

Y1 - 2019/9/12

N2 - Requesters on crowdsourcing platforms typically exercise the power to decide the fate of tasks completed by crowd workers. Rejecting work has a direct impact on workers; (i) they may not be rewarded for the work completed and for their effort that has been exerted, and (ii) rejection affects worker reputation and may limit their access to future work opportunities. This paper presents a comprehensive study that aims to understand worker moods and how workers react to rejections in microtask crowdsourcing. We experimentally investigate the effect of the mood of workers on their performance, and the interaction of their moods with their reactions to rejection. Finally, we explore techniques such as presenting social comparative explanations to foster positive reactions to rejection. We found that workers in pleasant moods significantly outperform those in unpleasant moods. Workers whose work is rejected due to narrowly failing pre-screening tests exhibited the most negative emotional responses.

AB - Requesters on crowdsourcing platforms typically exercise the power to decide the fate of tasks completed by crowd workers. Rejecting work has a direct impact on workers; (i) they may not be rewarded for the work completed and for their effort that has been exerted, and (ii) rejection affects worker reputation and may limit their access to future work opportunities. This paper presents a comprehensive study that aims to understand worker moods and how workers react to rejections in microtask crowdsourcing. We experimentally investigate the effect of the mood of workers on their performance, and the interaction of their moods with their reactions to rejection. Finally, we explore techniques such as presenting social comparative explanations to foster positive reactions to rejection. We found that workers in pleasant moods significantly outperform those in unpleasant moods. Workers whose work is rejected due to narrowly failing pre-screening tests exhibited the most negative emotional responses.

UR - http://www.scopus.com/inward/record.url?scp=85073340744&partnerID=8YFLogxK

U2 - 10.1145/3342220.3343644

DO - 10.1145/3342220.3343644

M3 - Conference contribution

AN - SCOPUS:85073340744

SP - 211

EP - 220

BT - HT 2019

CY - New York

T2 - 30th ACM Conference on Hypertext and Social Media, HT 2019

Y2 - 17 September 2019 through 20 September 2019

ER -