Exploring Scale Direction Effects and Response Behavior across PC and Smartphone Surveys

Publikation: Beitrag in FachzeitschriftÜbersichtsarbeitForschungPeer-Review

Autoren

  • Dagmar Krebs
  • Jan Karem Höhne

Externe Organisationen

  • Justus-Liebig-Universität Gießen
  • Universität Mannheim
  • Universität Pompeu Fabra (UPF)
Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Seiten (von - bis)477-495
Seitenumfang19
FachzeitschriftJournal of Survey Statistics and Methodology
Jahrgang9
Ausgabenummer3
PublikationsstatusVeröffentlicht - 20 März 2020
Extern publiziertJa

Abstract

The effects of scale direction on response behavior are well known in the survey literature, where a variety of theoretical approaches are discussed, and mixed empirical findings are reported. In addition, different types of survey completion devices seem to vary in their susceptibility to scale direction effects. In this study, we therefore investigate the effect of scale direction and device type on response behavior in PC and smartphone surveys. To do so, we conducted a web survey experiment in a German non-probability access panel (N = 3,401) using a two-step split-ballot design with four groups that are defined by device type (PC and smartphone) and scale direction (decremental and incremental). The results reveal that both PCs and smartphones are robust against scale direction effects. The results also show that response behavior differs substantially between PCs and smartphones, indicating that the device type (PC or smartphone) matters. In particular, the findings show that the comparability of data obtained through multi-device surveys is limited.

ASJC Scopus Sachgebiete

Zitieren

Exploring Scale Direction Effects and Response Behavior across PC and Smartphone Surveys. / Krebs, Dagmar; Höhne, Jan Karem.
in: Journal of Survey Statistics and Methodology, Jahrgang 9, Nr. 3, 20.03.2020, S. 477-495.

Publikation: Beitrag in FachzeitschriftÜbersichtsarbeitForschungPeer-Review

Krebs, D & Höhne, JK 2020, 'Exploring Scale Direction Effects and Response Behavior across PC and Smartphone Surveys', Journal of Survey Statistics and Methodology, Jg. 9, Nr. 3, S. 477-495. https://doi.org/10.1093/jssam/smz058
Krebs, D., & Höhne, J. K. (2020). Exploring Scale Direction Effects and Response Behavior across PC and Smartphone Surveys. Journal of Survey Statistics and Methodology, 9(3), 477-495. https://doi.org/10.1093/jssam/smz058
Krebs D, Höhne JK. Exploring Scale Direction Effects and Response Behavior across PC and Smartphone Surveys. Journal of Survey Statistics and Methodology. 2020 Mär 20;9(3):477-495. doi: 10.1093/jssam/smz058
Krebs, Dagmar ; Höhne, Jan Karem. / Exploring Scale Direction Effects and Response Behavior across PC and Smartphone Surveys. in: Journal of Survey Statistics and Methodology. 2020 ; Jahrgang 9, Nr. 3. S. 477-495.
Download
@article{fb0195619d5d4cfca59a4ebe59a94ad5,
title = "Exploring Scale Direction Effects and Response Behavior across PC and Smartphone Surveys",
abstract = "The effects of scale direction on response behavior are well known in the survey literature, where a variety of theoretical approaches are discussed, and mixed empirical findings are reported. In addition, different types of survey completion devices seem to vary in their susceptibility to scale direction effects. In this study, we therefore investigate the effect of scale direction and device type on response behavior in PC and smartphone surveys. To do so, we conducted a web survey experiment in a German non-probability access panel (N = 3,401) using a two-step split-ballot design with four groups that are defined by device type (PC and smartphone) and scale direction (decremental and incremental). The results reveal that both PCs and smartphones are robust against scale direction effects. The results also show that response behavior differs substantially between PCs and smartphones, indicating that the device type (PC or smartphone) matters. In particular, the findings show that the comparability of data obtained through multi-device surveys is limited.",
keywords = "Latent means, Measurement invariance, Multi-device survey, Rating scales, Response behavior, Scale direction",
author = "Dagmar Krebs and H{\"o}hne, {Jan Karem}",
year = "2020",
month = mar,
day = "20",
doi = "10.1093/jssam/smz058",
language = "English",
volume = "9",
pages = "477--495",
number = "3",

}

Download

TY - JOUR

T1 - Exploring Scale Direction Effects and Response Behavior across PC and Smartphone Surveys

AU - Krebs, Dagmar

AU - Höhne, Jan Karem

PY - 2020/3/20

Y1 - 2020/3/20

N2 - The effects of scale direction on response behavior are well known in the survey literature, where a variety of theoretical approaches are discussed, and mixed empirical findings are reported. In addition, different types of survey completion devices seem to vary in their susceptibility to scale direction effects. In this study, we therefore investigate the effect of scale direction and device type on response behavior in PC and smartphone surveys. To do so, we conducted a web survey experiment in a German non-probability access panel (N = 3,401) using a two-step split-ballot design with four groups that are defined by device type (PC and smartphone) and scale direction (decremental and incremental). The results reveal that both PCs and smartphones are robust against scale direction effects. The results also show that response behavior differs substantially between PCs and smartphones, indicating that the device type (PC or smartphone) matters. In particular, the findings show that the comparability of data obtained through multi-device surveys is limited.

AB - The effects of scale direction on response behavior are well known in the survey literature, where a variety of theoretical approaches are discussed, and mixed empirical findings are reported. In addition, different types of survey completion devices seem to vary in their susceptibility to scale direction effects. In this study, we therefore investigate the effect of scale direction and device type on response behavior in PC and smartphone surveys. To do so, we conducted a web survey experiment in a German non-probability access panel (N = 3,401) using a two-step split-ballot design with four groups that are defined by device type (PC and smartphone) and scale direction (decremental and incremental). The results reveal that both PCs and smartphones are robust against scale direction effects. The results also show that response behavior differs substantially between PCs and smartphones, indicating that the device type (PC or smartphone) matters. In particular, the findings show that the comparability of data obtained through multi-device surveys is limited.

KW - Latent means

KW - Measurement invariance

KW - Multi-device survey

KW - Rating scales

KW - Response behavior

KW - Scale direction

UR - http://www.scopus.com/inward/record.url?scp=85112342009&partnerID=8YFLogxK

U2 - 10.1093/jssam/smz058

DO - 10.1093/jssam/smz058

M3 - Review article

AN - SCOPUS:85112342009

VL - 9

SP - 477

EP - 495

JO - Journal of Survey Statistics and Methodology

JF - Journal of Survey Statistics and Methodology

SN - 2325-0984

IS - 3

ER -