Details
| Original language | English |
|---|---|
| Title of host publication | HT 2019 |
| Subtitle of host publication | Proceedings of the 30th ACM Conference on Hypertext and Social Media |
| Place of Publication | New York |
| Pages | 211-220 |
| Number of pages | 10 |
| ISBN (electronic) | 9781450368858 |
| Publication status | Published - 12 Sept 2019 |
| Event | 30th ACM Conference on Hypertext and Social Media, HT 2019 - Hof, Germany Duration: 17 Sept 2019 → 20 Sept 2019 |
Abstract
Requesters on crowdsourcing platforms typically exercise the power to decide the fate of tasks completed by crowd workers. Rejecting work has a direct impact on workers; (i) they may not be rewarded for the work completed and for their effort that has been exerted, and (ii) rejection affects worker reputation and may limit their access to future work opportunities. This paper presents a comprehensive study that aims to understand worker moods and how workers react to rejections in microtask crowdsourcing. We experimentally investigate the effect of the mood of workers on their performance, and the interaction of their moods with their reactions to rejection. Finally, we explore techniques such as presenting social comparative explanations to foster positive reactions to rejection. We found that workers in pleasant moods significantly outperform those in unpleasant moods. Workers whose work is rejected due to narrowly failing pre-screening tests exhibited the most negative emotional responses.
ASJC Scopus subject areas
- Computer Science(all)
- Software
- Computer Science(all)
- Artificial Intelligence
- Computer Science(all)
- Human-Computer Interaction
- Computer Science(all)
- Computer Graphics and Computer-Aided Design
Cite this
- Standard
- Harvard
- Apa
- Vancouver
- BibTeX
- RIS
HT 2019: Proceedings of the 30th ACM Conference on Hypertext and Social Media. New York, 2019. p. 211-220.
Research output: Chapter in book/report/conference proceeding › Conference contribution › Research › peer review
}
TY - GEN
T1 - Understanding worker moods and reactions to rejection in crowdsourcing
AU - Gadiraju, Ujwal Kumar
AU - Demartini, Gianluca
N1 - Funding information: We thank all the workers who participated in our experiments. This research has been supported in part by the Erasmus+ project DISKOW (grant no. 60171990), and EU's H2020 (grant no. 732328).
PY - 2019/9/12
Y1 - 2019/9/12
N2 - Requesters on crowdsourcing platforms typically exercise the power to decide the fate of tasks completed by crowd workers. Rejecting work has a direct impact on workers; (i) they may not be rewarded for the work completed and for their effort that has been exerted, and (ii) rejection affects worker reputation and may limit their access to future work opportunities. This paper presents a comprehensive study that aims to understand worker moods and how workers react to rejections in microtask crowdsourcing. We experimentally investigate the effect of the mood of workers on their performance, and the interaction of their moods with their reactions to rejection. Finally, we explore techniques such as presenting social comparative explanations to foster positive reactions to rejection. We found that workers in pleasant moods significantly outperform those in unpleasant moods. Workers whose work is rejected due to narrowly failing pre-screening tests exhibited the most negative emotional responses.
AB - Requesters on crowdsourcing platforms typically exercise the power to decide the fate of tasks completed by crowd workers. Rejecting work has a direct impact on workers; (i) they may not be rewarded for the work completed and for their effort that has been exerted, and (ii) rejection affects worker reputation and may limit their access to future work opportunities. This paper presents a comprehensive study that aims to understand worker moods and how workers react to rejections in microtask crowdsourcing. We experimentally investigate the effect of the mood of workers on their performance, and the interaction of their moods with their reactions to rejection. Finally, we explore techniques such as presenting social comparative explanations to foster positive reactions to rejection. We found that workers in pleasant moods significantly outperform those in unpleasant moods. Workers whose work is rejected due to narrowly failing pre-screening tests exhibited the most negative emotional responses.
UR - http://www.scopus.com/inward/record.url?scp=85073340744&partnerID=8YFLogxK
U2 - 10.1145/3342220.3343644
DO - 10.1145/3342220.3343644
M3 - Conference contribution
AN - SCOPUS:85073340744
SP - 211
EP - 220
BT - HT 2019
CY - New York
T2 - 30th ACM Conference on Hypertext and Social Media, HT 2019
Y2 - 17 September 2019 through 20 September 2019
ER -