Details
| Original language | English |
|---|---|
| Title of host publication | ACM UMAP 2019 |
| Subtitle of host publication | Proceedings of the 27th ACM Conference on User Modeling, Adaptation and Personalization |
| Editors | George Aneglos Papadopoulos, George Samaras, Stephan Weibelzahl, Dietmar Jannach, Olga C. Santos |
| Place of Publication | New York |
| Pages | 243-251 |
| Number of pages | 9 |
| ISBN (electronic) | 9781450360210 |
| Publication status | Published - 7 Jun 2019 |
| Event | 27th ACM Conference on User Modeling, Adaptation and Personalization, UMAP 2019 - Larnaca, Cyprus Duration: 9 Jun 2019 → 12 Jun 2019 |
Abstract
Conversational interfaces can facilitate human-computer interactions. Whether or not conversational interfaces can improve worker experience and work quality in crowdsourcing marketplaces has remained unanswered. We investigate the suitability of text-based conversational interfaces for microtask crowdsourcing. We designed a rigorous experimental campaign aimed at gauging the interest and acceptance by crowdworkers for this type of work interface. We compared Web and conversational interfaces for five common microtask types and measured the execution time, quality of work, and the perceived satisfaction of 316 workers recruited from the FigureEight platform. We show that conversational interfaces can be used effectively for crowdsourcing microtasks, resulting in a high satisfaction from workers, and without having a negative impact on task execution time or work quality.
Keywords
- Chatbots, Conversational agents, Microtask crowdsourcing
ASJC Scopus subject areas
- Computer Science(all)
- Software
Cite this
- Standard
- Harvard
- Apa
- Vancouver
- BibTeX
- RIS
ACM UMAP 2019: Proceedings of the 27th ACM Conference on User Modeling, Adaptation and Personalization. ed. / George Aneglos Papadopoulos; George Samaras; Stephan Weibelzahl; Dietmar Jannach; Olga C. Santos. New York, 2019. p. 243-251.
Research output: Chapter in book/report/conference proceeding › Conference contribution › Research › peer review
}
TY - GEN
T1 - Chatterbox
T2 - 27th ACM Conference on User Modeling, Adaptation and Personalization, UMAP 2019
AU - Mavridis, Panagiotis
AU - Huang, Owen
AU - Qiu, Sihang
AU - Gadiraju, Ujwal
AU - Bozzon, Alessandro
N1 - Acknowledgements: This research has been supported in part by the Amsterdam Institute for Advanced Metropolitan Solutions with the AMS Social Bot grant, by the Dutch national e-infrastructure with the support of SURF Cooperative (grant e-infra170237), and by the Erasmus+ project DISKOW (grant no. 60171990). We also thank all the anonymous crowdworkers from F8 who participated in our experiments.
PY - 2019/6/7
Y1 - 2019/6/7
N2 - Conversational interfaces can facilitate human-computer interactions. Whether or not conversational interfaces can improve worker experience and work quality in crowdsourcing marketplaces has remained unanswered. We investigate the suitability of text-based conversational interfaces for microtask crowdsourcing. We designed a rigorous experimental campaign aimed at gauging the interest and acceptance by crowdworkers for this type of work interface. We compared Web and conversational interfaces for five common microtask types and measured the execution time, quality of work, and the perceived satisfaction of 316 workers recruited from the FigureEight platform. We show that conversational interfaces can be used effectively for crowdsourcing microtasks, resulting in a high satisfaction from workers, and without having a negative impact on task execution time or work quality.
AB - Conversational interfaces can facilitate human-computer interactions. Whether or not conversational interfaces can improve worker experience and work quality in crowdsourcing marketplaces has remained unanswered. We investigate the suitability of text-based conversational interfaces for microtask crowdsourcing. We designed a rigorous experimental campaign aimed at gauging the interest and acceptance by crowdworkers for this type of work interface. We compared Web and conversational interfaces for five common microtask types and measured the execution time, quality of work, and the perceived satisfaction of 316 workers recruited from the FigureEight platform. We show that conversational interfaces can be used effectively for crowdsourcing microtasks, resulting in a high satisfaction from workers, and without having a negative impact on task execution time or work quality.
KW - Chatbots
KW - Conversational agents
KW - Microtask crowdsourcing
UR - http://www.scopus.com/inward/record.url?scp=85068045274&partnerID=8YFLogxK
U2 - 10.1145/3320435.3320439
DO - 10.1145/3320435.3320439
M3 - Conference contribution
AN - SCOPUS:85068045274
SP - 243
EP - 251
BT - ACM UMAP 2019
A2 - Papadopoulos, George Aneglos
A2 - Samaras, George
A2 - Weibelzahl, Stephan
A2 - Jannach, Dietmar
A2 - Santos, Olga C.
CY - New York
Y2 - 9 June 2019 through 12 June 2019
ER -