Crowdsourcing versus the laboratory: Towards human-centered experiments using the crowd

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandBeitrag in Buch/SammelwerkForschungPeer-Review

Autoren

  • Ujwal Gadiraju
  • Sebastian Möller
  • Martin Nöllenburg
  • Dietmar Saupe
  • Sebastian Egger-Lampl
  • Daniel Archambault
  • Brian Fisher

Organisationseinheiten

Externe Organisationen

  • Technische Universität Berlin
  • Universität Konstanz
  • AIT Austrian Institute of Technology GmbH
  • Swansea University
  • Simon Fraser University
  • Technische Universität Wien (TUW)
Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Titel des SammelwerksLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Seiten6-26
Seitenumfang21
ISBN (elektronisch)978-3-319-66435-4
PublikationsstatusVeröffentlicht - 2017

Publikationsreihe

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Band10264 LNCS
ISSN (Print)0302-9743
ISSN (elektronisch)1611-3349

Abstract

Crowdsourcing solutions are increasingly being adopted across a variety of domains these days. An important consequence of the flourishing crowdsourcing markets is that experiments which were traditionally carried out in laboratories on a much smaller scale can now tap into the immense potential of online labor. Researchers in different fields have shown considerable interest in attempting to carry out priorly constrained lab experiments in the crowd. In this chapter, we reflect on the key factors to consider while transitioning from controlled laboratory experiments to large scale experiments in the crowd.

ASJC Scopus Sachgebiete

Zitieren

Crowdsourcing versus the laboratory: Towards human-centered experiments using the crowd. / Gadiraju, Ujwal; Möller, Sebastian; Nöllenburg, Martin et al.
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 2017. S. 6-26 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Band 10264 LNCS).

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandBeitrag in Buch/SammelwerkForschungPeer-Review

Gadiraju, U, Möller, S, Nöllenburg, M, Saupe, D, Egger-Lampl, S, Archambault, D & Fisher, B 2017, Crowdsourcing versus the laboratory: Towards human-centered experiments using the crowd. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Bd. 10264 LNCS, S. 6-26. https://doi.org/10.1007/978-3-319-66435-4_2, https://doi.org/10.1007/978-3-319-66435-4_8
Gadiraju, U., Möller, S., Nöllenburg, M., Saupe, D., Egger-Lampl, S., Archambault, D., & Fisher, B. (2017). Crowdsourcing versus the laboratory: Towards human-centered experiments using the crowd. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (S. 6-26). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Band 10264 LNCS). https://doi.org/10.1007/978-3-319-66435-4_2, https://doi.org/10.1007/978-3-319-66435-4_8
Gadiraju U, Möller S, Nöllenburg M, Saupe D, Egger-Lampl S, Archambault D et al. Crowdsourcing versus the laboratory: Towards human-centered experiments using the crowd. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 2017. S. 6-26. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). Epub 2017 Sep 28. doi: 10.1007/978-3-319-66435-4_2, 10.1007/978-3-319-66435-4_8
Gadiraju, Ujwal ; Möller, Sebastian ; Nöllenburg, Martin et al. / Crowdsourcing versus the laboratory : Towards human-centered experiments using the crowd. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 2017. S. 6-26 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
Download
@inbook{424b78bcedde4ba2a8ea1941ecd75626,
title = "Crowdsourcing versus the laboratory: Towards human-centered experiments using the crowd",
abstract = "Crowdsourcing solutions are increasingly being adopted across a variety of domains these days. An important consequence of the flourishing crowdsourcing markets is that experiments which were traditionally carried out in laboratories on a much smaller scale can now tap into the immense potential of online labor. Researchers in different fields have shown considerable interest in attempting to carry out priorly constrained lab experiments in the crowd. In this chapter, we reflect on the key factors to consider while transitioning from controlled laboratory experiments to large scale experiments in the crowd.",
author = "Ujwal Gadiraju and Sebastian M{\"o}ller and Martin N{\"o}llenburg and Dietmar Saupe and Sebastian Egger-Lampl and Daniel Archambault and Brian Fisher",
note = "Funding Information: Acknowledgment. We would like to thank Dagstuhl for facilitating the seminar (titled, {\textquoteleft}Evaluation in the Crowd: Crowdsourcing and Human-Centred Experiments {\textquoteright}) that brought about this collaboration. Part of this work (Sect. 4) was supported by the German Research Foundation (DFG) within project A05 of SFB/Transregio 161. We also thank Andrea Mauri and Christian Keimel for their valuable contributions and feedback during discussions. ",
year = "2017",
doi = "10.1007/978-3-319-66435-4_2",
language = "English",
isbn = "978-3-319-66434-7",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
pages = "6--26",
booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

}

Download

TY - CHAP

T1 - Crowdsourcing versus the laboratory

T2 - Towards human-centered experiments using the crowd

AU - Gadiraju, Ujwal

AU - Möller, Sebastian

AU - Nöllenburg, Martin

AU - Saupe, Dietmar

AU - Egger-Lampl, Sebastian

AU - Archambault, Daniel

AU - Fisher, Brian

N1 - Funding Information: Acknowledgment. We would like to thank Dagstuhl for facilitating the seminar (titled, ‘Evaluation in the Crowd: Crowdsourcing and Human-Centred Experiments ’) that brought about this collaboration. Part of this work (Sect. 4) was supported by the German Research Foundation (DFG) within project A05 of SFB/Transregio 161. We also thank Andrea Mauri and Christian Keimel for their valuable contributions and feedback during discussions.

PY - 2017

Y1 - 2017

N2 - Crowdsourcing solutions are increasingly being adopted across a variety of domains these days. An important consequence of the flourishing crowdsourcing markets is that experiments which were traditionally carried out in laboratories on a much smaller scale can now tap into the immense potential of online labor. Researchers in different fields have shown considerable interest in attempting to carry out priorly constrained lab experiments in the crowd. In this chapter, we reflect on the key factors to consider while transitioning from controlled laboratory experiments to large scale experiments in the crowd.

AB - Crowdsourcing solutions are increasingly being adopted across a variety of domains these days. An important consequence of the flourishing crowdsourcing markets is that experiments which were traditionally carried out in laboratories on a much smaller scale can now tap into the immense potential of online labor. Researchers in different fields have shown considerable interest in attempting to carry out priorly constrained lab experiments in the crowd. In this chapter, we reflect on the key factors to consider while transitioning from controlled laboratory experiments to large scale experiments in the crowd.

UR - http://www.scopus.com/inward/record.url?scp=85031492049&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-66435-4_2

DO - 10.1007/978-3-319-66435-4_2

M3 - Contribution to book/anthology

AN - SCOPUS:85031492049

SN - 978-3-319-66434-7

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 6

EP - 26

BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

ER -