Motion instructions in surveys: Compliance, acceleration, and response quality

Research output: Contribution to journalArticleResearchpeer review

Authors

  • Jan Karem Höhne
  • Melanie Revilla
  • Stephan Schlosser

External Research Organisations

  • University of Mannheim
  • Universität Pompeu Fabra (UPF)
  • University of Göttingen
View graph of relations

Details

Original languageEnglish
Pages (from-to)43-57
Number of pages15
JournalInternational Journal of Market Research
Volume62
Issue number1
Early online date27 Jun 2019
Publication statusPublished - 1 Jan 2020
Externally publishedYes

Abstract

The increased use of smartphones in web survey responding did not only raise new research questions but also fostered new ways to research survey completion behavior. Smartphones have many built-in sensors, such as accelerometers that measure acceleration (i.e., the rate of change of velocity of an object over time). Sensor data establish new research opportunities by providing information about physical completion conditions that, for instance, can affect response quality. In this study, we explore three research questions: (1) To what extent do respondents accept to comply with motion instructions? (2) What variables affect the acceleration of smartphones? (3) Do different motion levels affect response quality? We conducted a smartphone web survey experiment using the Netquest opt-in panel in Spain and asked respondents to stand at a fix point or walk around while answering five single questions. The results reveal high compliance with motion instructions, with compliance being higher in the standing than in the walking condition. We also discovered that several variables, such as the presence of third parties, increase the acceleration of smartphones. However, the quality of responses to the five single questions did not differ significantly between the motion conditions, a finding that is in line with previous research. Our findings provide new insights into how compliance changes with motion tasks and suggest that the collection of acceleration data is a feasible and fruitful way to explore survey completion behavior. The findings also indicate that refined research on the connection between motion levels and response quality is necessary.

Keywords

    accelerometer, compliance, response quality, smartphones, survey completion behavior, SurveyMotion, web survey

ASJC Scopus subject areas

Cite this

Motion instructions in surveys: Compliance, acceleration, and response quality. / Höhne, Jan Karem; Revilla, Melanie; Schlosser, Stephan.
In: International Journal of Market Research, Vol. 62, No. 1, 01.01.2020, p. 43-57.

Research output: Contribution to journalArticleResearchpeer review

Höhne JK, Revilla M, Schlosser S. Motion instructions in surveys: Compliance, acceleration, and response quality. International Journal of Market Research. 2020 Jan 1;62(1):43-57. Epub 2019 Jun 27. doi: 10.1177/1470785319858587
Höhne, Jan Karem ; Revilla, Melanie ; Schlosser, Stephan. / Motion instructions in surveys : Compliance, acceleration, and response quality. In: International Journal of Market Research. 2020 ; Vol. 62, No. 1. pp. 43-57.
Download
@article{fcee9e0570554a088caaa2c7875e6ce2,
title = "Motion instructions in surveys: Compliance, acceleration, and response quality",
abstract = "The increased use of smartphones in web survey responding did not only raise new research questions but also fostered new ways to research survey completion behavior. Smartphones have many built-in sensors, such as accelerometers that measure acceleration (i.e., the rate of change of velocity of an object over time). Sensor data establish new research opportunities by providing information about physical completion conditions that, for instance, can affect response quality. In this study, we explore three research questions: (1) To what extent do respondents accept to comply with motion instructions? (2) What variables affect the acceleration of smartphones? (3) Do different motion levels affect response quality? We conducted a smartphone web survey experiment using the Netquest opt-in panel in Spain and asked respondents to stand at a fix point or walk around while answering five single questions. The results reveal high compliance with motion instructions, with compliance being higher in the standing than in the walking condition. We also discovered that several variables, such as the presence of third parties, increase the acceleration of smartphones. However, the quality of responses to the five single questions did not differ significantly between the motion conditions, a finding that is in line with previous research. Our findings provide new insights into how compliance changes with motion tasks and suggest that the collection of acceleration data is a feasible and fruitful way to explore survey completion behavior. The findings also indicate that refined research on the connection between motion levels and response quality is necessary.",
keywords = "accelerometer, compliance, response quality, smartphones, survey completion behavior, SurveyMotion, web survey",
author = "H{\"o}hne, {Jan Karem} and Melanie Revilla and Stephan Schlosser",
year = "2020",
month = jan,
day = "1",
doi = "10.1177/1470785319858587",
language = "English",
volume = "62",
pages = "43--57",
journal = "International Journal of Market Research",
issn = "1470-7853",
publisher = "Market Research Society",
number = "1",

}

Download

TY - JOUR

T1 - Motion instructions in surveys

T2 - Compliance, acceleration, and response quality

AU - Höhne, Jan Karem

AU - Revilla, Melanie

AU - Schlosser, Stephan

PY - 2020/1/1

Y1 - 2020/1/1

N2 - The increased use of smartphones in web survey responding did not only raise new research questions but also fostered new ways to research survey completion behavior. Smartphones have many built-in sensors, such as accelerometers that measure acceleration (i.e., the rate of change of velocity of an object over time). Sensor data establish new research opportunities by providing information about physical completion conditions that, for instance, can affect response quality. In this study, we explore three research questions: (1) To what extent do respondents accept to comply with motion instructions? (2) What variables affect the acceleration of smartphones? (3) Do different motion levels affect response quality? We conducted a smartphone web survey experiment using the Netquest opt-in panel in Spain and asked respondents to stand at a fix point or walk around while answering five single questions. The results reveal high compliance with motion instructions, with compliance being higher in the standing than in the walking condition. We also discovered that several variables, such as the presence of third parties, increase the acceleration of smartphones. However, the quality of responses to the five single questions did not differ significantly between the motion conditions, a finding that is in line with previous research. Our findings provide new insights into how compliance changes with motion tasks and suggest that the collection of acceleration data is a feasible and fruitful way to explore survey completion behavior. The findings also indicate that refined research on the connection between motion levels and response quality is necessary.

AB - The increased use of smartphones in web survey responding did not only raise new research questions but also fostered new ways to research survey completion behavior. Smartphones have many built-in sensors, such as accelerometers that measure acceleration (i.e., the rate of change of velocity of an object over time). Sensor data establish new research opportunities by providing information about physical completion conditions that, for instance, can affect response quality. In this study, we explore three research questions: (1) To what extent do respondents accept to comply with motion instructions? (2) What variables affect the acceleration of smartphones? (3) Do different motion levels affect response quality? We conducted a smartphone web survey experiment using the Netquest opt-in panel in Spain and asked respondents to stand at a fix point or walk around while answering five single questions. The results reveal high compliance with motion instructions, with compliance being higher in the standing than in the walking condition. We also discovered that several variables, such as the presence of third parties, increase the acceleration of smartphones. However, the quality of responses to the five single questions did not differ significantly between the motion conditions, a finding that is in line with previous research. Our findings provide new insights into how compliance changes with motion tasks and suggest that the collection of acceleration data is a feasible and fruitful way to explore survey completion behavior. The findings also indicate that refined research on the connection between motion levels and response quality is necessary.

KW - accelerometer

KW - compliance

KW - response quality

KW - smartphones

KW - survey completion behavior

KW - SurveyMotion

KW - web survey

UR - http://www.scopus.com/inward/record.url?scp=85077537628&partnerID=8YFLogxK

U2 - 10.1177/1470785319858587

DO - 10.1177/1470785319858587

M3 - Article

AN - SCOPUS:85077537628

VL - 62

SP - 43

EP - 57

JO - International Journal of Market Research

JF - International Journal of Market Research

SN - 1470-7853

IS - 1

ER -