Switching away: Exploring on-device media multitasking in web surveys

Research output: Contribution to journalArticleResearchpeer review

Authors

  • Jan Karem Höhne
  • Stephan Schlosser
  • Mick P. Couper
  • Annelies G. Blom

External Research Organisations

  • University of Mannheim
  • Universität Pompeu Fabra (UPF)
  • University of Göttingen
  • University of Michigan
View graph of relations

Details

Original languageEnglish
Article number106417
JournalComputers in human behavior
Volume111
Early online date6 May 2020
Publication statusPublished - Oct 2020
Externally publishedYes

Abstract

The use of web surveys is a common and popular data collection method in behavioral and social research. Compared to other established survey modes, web surveys are frequently cheaper and less time consuming, because they are commonly self-administered. They also allow respondents to take part with few time and location restrictions. However, research has shown that web surveys are frequently associated with multitasking, which may negatively affect response behavior and response quality. In this study, we use paradata detecting switching away from the web survey to explore on-device media multitasking. We conducted a web survey in an opt-in access panel in Germany and randomly assigned respondents to a PC or smartphone condition. The results reveal that on-device media multitasking is more common on PCs than on smartphones. We also find evidence that engaging in on-device media multitasking affects response quality. Respondents who switch away are more likely to select the middle response category. In addition, the results show that the question presentation format, the device type, and respondents’ age and education are associated with the occurrence of on-device media multitasking. These findings point to the importance of controlling for on-device media multitasking in web surveys.

Keywords

    JavaScript, Mixed-device survey, Multitasking, OnBlur functions, Paradata, Response quality

ASJC Scopus subject areas

Cite this

Switching away: Exploring on-device media multitasking in web surveys. / Höhne, Jan Karem; Schlosser, Stephan; Couper, Mick P. et al.
In: Computers in human behavior, Vol. 111, 106417, 10.2020.

Research output: Contribution to journalArticleResearchpeer review

Höhne, J. K., Schlosser, S., Couper, M. P., & Blom, A. G. (2020). Switching away: Exploring on-device media multitasking in web surveys. Computers in human behavior, 111, Article 106417. https://doi.org/10.1016/j.chb.2020.106417
Höhne JK, Schlosser S, Couper MP, Blom AG. Switching away: Exploring on-device media multitasking in web surveys. Computers in human behavior. 2020 Oct;111:106417. Epub 2020 May 6. doi: 10.1016/j.chb.2020.106417
Höhne, Jan Karem ; Schlosser, Stephan ; Couper, Mick P. et al. / Switching away : Exploring on-device media multitasking in web surveys. In: Computers in human behavior. 2020 ; Vol. 111.
Download
@article{2745c2437e014ec88f388301b5a579a6,
title = "Switching away: Exploring on-device media multitasking in web surveys",
abstract = "The use of web surveys is a common and popular data collection method in behavioral and social research. Compared to other established survey modes, web surveys are frequently cheaper and less time consuming, because they are commonly self-administered. They also allow respondents to take part with few time and location restrictions. However, research has shown that web surveys are frequently associated with multitasking, which may negatively affect response behavior and response quality. In this study, we use paradata detecting switching away from the web survey to explore on-device media multitasking. We conducted a web survey in an opt-in access panel in Germany and randomly assigned respondents to a PC or smartphone condition. The results reveal that on-device media multitasking is more common on PCs than on smartphones. We also find evidence that engaging in on-device media multitasking affects response quality. Respondents who switch away are more likely to select the middle response category. In addition, the results show that the question presentation format, the device type, and respondents{\textquoteright} age and education are associated with the occurrence of on-device media multitasking. These findings point to the importance of controlling for on-device media multitasking in web surveys.",
keywords = "JavaScript, Mixed-device survey, Multitasking, OnBlur functions, Paradata, Response quality",
author = "H{\"o}hne, {Jan Karem} and Stephan Schlosser and Couper, {Mick P.} and Blom, {Annelies G.}",
note = "Funding Information: We acknowledge funding by German Science Foundation through the Collaborative Research Center 884 “Political Economy of Reforms” (grant number: 139943784 ). Publisher ",
year = "2020",
month = oct,
doi = "10.1016/j.chb.2020.106417",
language = "English",
volume = "111",
journal = "Computers in human behavior",
issn = "0747-5632",
publisher = "Elsevier Ltd.",

}

Download

TY - JOUR

T1 - Switching away

T2 - Exploring on-device media multitasking in web surveys

AU - Höhne, Jan Karem

AU - Schlosser, Stephan

AU - Couper, Mick P.

AU - Blom, Annelies G.

N1 - Funding Information: We acknowledge funding by German Science Foundation through the Collaborative Research Center 884 “Political Economy of Reforms” (grant number: 139943784 ). Publisher

PY - 2020/10

Y1 - 2020/10

N2 - The use of web surveys is a common and popular data collection method in behavioral and social research. Compared to other established survey modes, web surveys are frequently cheaper and less time consuming, because they are commonly self-administered. They also allow respondents to take part with few time and location restrictions. However, research has shown that web surveys are frequently associated with multitasking, which may negatively affect response behavior and response quality. In this study, we use paradata detecting switching away from the web survey to explore on-device media multitasking. We conducted a web survey in an opt-in access panel in Germany and randomly assigned respondents to a PC or smartphone condition. The results reveal that on-device media multitasking is more common on PCs than on smartphones. We also find evidence that engaging in on-device media multitasking affects response quality. Respondents who switch away are more likely to select the middle response category. In addition, the results show that the question presentation format, the device type, and respondents’ age and education are associated with the occurrence of on-device media multitasking. These findings point to the importance of controlling for on-device media multitasking in web surveys.

AB - The use of web surveys is a common and popular data collection method in behavioral and social research. Compared to other established survey modes, web surveys are frequently cheaper and less time consuming, because they are commonly self-administered. They also allow respondents to take part with few time and location restrictions. However, research has shown that web surveys are frequently associated with multitasking, which may negatively affect response behavior and response quality. In this study, we use paradata detecting switching away from the web survey to explore on-device media multitasking. We conducted a web survey in an opt-in access panel in Germany and randomly assigned respondents to a PC or smartphone condition. The results reveal that on-device media multitasking is more common on PCs than on smartphones. We also find evidence that engaging in on-device media multitasking affects response quality. Respondents who switch away are more likely to select the middle response category. In addition, the results show that the question presentation format, the device type, and respondents’ age and education are associated with the occurrence of on-device media multitasking. These findings point to the importance of controlling for on-device media multitasking in web surveys.

KW - JavaScript

KW - Mixed-device survey

KW - Multitasking

KW - OnBlur functions

KW - Paradata

KW - Response quality

UR - http://www.scopus.com/inward/record.url?scp=85086894538&partnerID=8YFLogxK

U2 - 10.1016/j.chb.2020.106417

DO - 10.1016/j.chb.2020.106417

M3 - Article

AN - SCOPUS:85086894538

VL - 111

JO - Computers in human behavior

JF - Computers in human behavior

SN - 0747-5632

M1 - 106417

ER -