Details
| Original language | English |
|---|---|
| Title of host publication | HT 2018 - Proceedings of the 29th ACM Conference on Hypertext and Social Media |
| Pages | 115-122 |
| Number of pages | 8 |
| ISBN (electronic) | 9781450354271 |
| Publication status | Published - 3 Jul 2018 |
| Event | 29th ACM International Conference on Hypertext and Social Media, HT 2018 - Baltimore, United States Duration: 9 Jul 2018 → 12 Jul 2018 |
Publication series
| Name | HT 2018 - Proceedings of the 29th ACM Conference on Hypertext and Social Media |
|---|
Abstract
Workers in microtask crowdsourcing systems typically consume different types of tasks. Task consumption is driven by the selfselection of workers in the most popular platforms such as Amazon Mechanical Turk and CrowdFlower. Workers typically complete tasks one after another in a chain. Prior works have revealed the impact of ordering tasks while considering aspects such as task complexity. However, little is understood about the benefits of considering task similarity in microtask chains. In this paper, we investigate the role of task similarity in microtask crowdsourcing and how it affects market dynamics. We identified different dimensions that affect the perception of task similarity among workers, and propose a supervised machine learning model to predict the overall task similarity of a task pair. Leveraging task similarity, we studied the effects of similarity on worker retention, satisfaction, boredom and fatigue. We reveal the impact of chaining tasks according to their similarity on worker accuracy and their task completion time. Our findings enrich the current understanding of crowd work and bear important implications on structuring workflow.
Keywords
- Crowdsourcing, Microtasks, Performance, Task similarity, Workers
ASJC Scopus subject areas
- Computer Science(all)
- Software
- Computer Science(all)
- Artificial Intelligence
- Computer Science(all)
- Human-Computer Interaction
- Computer Science(all)
- Computer Graphics and Computer-Aided Design
Cite this
- Standard
- Harvard
- Apa
- Vancouver
- BibTeX
- RIS
HT 2018 - Proceedings of the 29th ACM Conference on Hypertext and Social Media. 2018. p. 115-122 (HT 2018 - Proceedings of the 29th ACM Conference on Hypertext and Social Media).
Research output: Chapter in book/report/conference proceeding › Conference contribution › Research › peer review
}
TY - GEN
T1 - SimilarHITs
T2 - 29th ACM International Conference on Hypertext and Social Media, HT 2018
AU - Aipe, Alan
AU - Gadiraju, Ujwal
N1 - Funding information: This research has been supported in part by the European Commission within the H2020-ICT-2015 Programme (Analytics For Everyday Learning (AFEL) project, Grant Agreement No. 687916).
PY - 2018/7/3
Y1 - 2018/7/3
N2 - Workers in microtask crowdsourcing systems typically consume different types of tasks. Task consumption is driven by the selfselection of workers in the most popular platforms such as Amazon Mechanical Turk and CrowdFlower. Workers typically complete tasks one after another in a chain. Prior works have revealed the impact of ordering tasks while considering aspects such as task complexity. However, little is understood about the benefits of considering task similarity in microtask chains. In this paper, we investigate the role of task similarity in microtask crowdsourcing and how it affects market dynamics. We identified different dimensions that affect the perception of task similarity among workers, and propose a supervised machine learning model to predict the overall task similarity of a task pair. Leveraging task similarity, we studied the effects of similarity on worker retention, satisfaction, boredom and fatigue. We reveal the impact of chaining tasks according to their similarity on worker accuracy and their task completion time. Our findings enrich the current understanding of crowd work and bear important implications on structuring workflow.
AB - Workers in microtask crowdsourcing systems typically consume different types of tasks. Task consumption is driven by the selfselection of workers in the most popular platforms such as Amazon Mechanical Turk and CrowdFlower. Workers typically complete tasks one after another in a chain. Prior works have revealed the impact of ordering tasks while considering aspects such as task complexity. However, little is understood about the benefits of considering task similarity in microtask chains. In this paper, we investigate the role of task similarity in microtask crowdsourcing and how it affects market dynamics. We identified different dimensions that affect the perception of task similarity among workers, and propose a supervised machine learning model to predict the overall task similarity of a task pair. Leveraging task similarity, we studied the effects of similarity on worker retention, satisfaction, boredom and fatigue. We reveal the impact of chaining tasks according to their similarity on worker accuracy and their task completion time. Our findings enrich the current understanding of crowd work and bear important implications on structuring workflow.
KW - Crowdsourcing
KW - Microtasks
KW - Performance
KW - Task similarity
KW - Workers
UR - http://www.scopus.com/inward/record.url?scp=85051497034&partnerID=8YFLogxK
U2 - 10.1145/3209542.3209558
DO - 10.1145/3209542.3209558
M3 - Conference contribution
AN - SCOPUS:85051497034
T3 - HT 2018 - Proceedings of the 29th ACM Conference on Hypertext and Social Media
SP - 115
EP - 122
BT - HT 2018 - Proceedings of the 29th ACM Conference on Hypertext and Social Media
Y2 - 9 July 2018 through 12 July 2018
ER -