Details
| Original language | English |
|---|---|
| Pages (from-to) | 477-495 |
| Number of pages | 19 |
| Journal | Journal of Survey Statistics and Methodology |
| Volume | 9 |
| Issue number | 3 |
| Publication status | Published - 20 Mar 2020 |
| Externally published | Yes |
Abstract
The effects of scale direction on response behavior are well known in the survey literature, where a variety of theoretical approaches are discussed, and mixed empirical findings are reported. In addition, different types of survey completion devices seem to vary in their susceptibility to scale direction effects. In this study, we therefore investigate the effect of scale direction and device type on response behavior in PC and smartphone surveys. To do so, we conducted a web survey experiment in a German non-probability access panel (N = 3,401) using a two-step split-ballot design with four groups that are defined by device type (PC and smartphone) and scale direction (decremental and incremental). The results reveal that both PCs and smartphones are robust against scale direction effects. The results also show that response behavior differs substantially between PCs and smartphones, indicating that the device type (PC or smartphone) matters. In particular, the findings show that the comparability of data obtained through multi-device surveys is limited.
Keywords
- Latent means, Measurement invariance, Multi-device survey, Rating scales, Response behavior, Scale direction
ASJC Scopus subject areas
- Mathematics(all)
- Statistics and Probability
- Social Sciences(all)
- Social Sciences (miscellaneous)
- Decision Sciences(all)
- Statistics, Probability and Uncertainty
- Mathematics(all)
- Applied Mathematics
Cite this
- Standard
- Harvard
- Apa
- Vancouver
- BibTeX
- RIS
In: Journal of Survey Statistics and Methodology, Vol. 9, No. 3, 20.03.2020, p. 477-495.
Research output: Contribution to journal › Review article › Research › peer review
}
TY - JOUR
T1 - Exploring Scale Direction Effects and Response Behavior across PC and Smartphone Surveys
AU - Krebs, Dagmar
AU - Höhne, Jan Karem
PY - 2020/3/20
Y1 - 2020/3/20
N2 - The effects of scale direction on response behavior are well known in the survey literature, where a variety of theoretical approaches are discussed, and mixed empirical findings are reported. In addition, different types of survey completion devices seem to vary in their susceptibility to scale direction effects. In this study, we therefore investigate the effect of scale direction and device type on response behavior in PC and smartphone surveys. To do so, we conducted a web survey experiment in a German non-probability access panel (N = 3,401) using a two-step split-ballot design with four groups that are defined by device type (PC and smartphone) and scale direction (decremental and incremental). The results reveal that both PCs and smartphones are robust against scale direction effects. The results also show that response behavior differs substantially between PCs and smartphones, indicating that the device type (PC or smartphone) matters. In particular, the findings show that the comparability of data obtained through multi-device surveys is limited.
AB - The effects of scale direction on response behavior are well known in the survey literature, where a variety of theoretical approaches are discussed, and mixed empirical findings are reported. In addition, different types of survey completion devices seem to vary in their susceptibility to scale direction effects. In this study, we therefore investigate the effect of scale direction and device type on response behavior in PC and smartphone surveys. To do so, we conducted a web survey experiment in a German non-probability access panel (N = 3,401) using a two-step split-ballot design with four groups that are defined by device type (PC and smartphone) and scale direction (decremental and incremental). The results reveal that both PCs and smartphones are robust against scale direction effects. The results also show that response behavior differs substantially between PCs and smartphones, indicating that the device type (PC or smartphone) matters. In particular, the findings show that the comparability of data obtained through multi-device surveys is limited.
KW - Latent means
KW - Measurement invariance
KW - Multi-device survey
KW - Rating scales
KW - Response behavior
KW - Scale direction
UR - http://www.scopus.com/inward/record.url?scp=85112342009&partnerID=8YFLogxK
U2 - 10.1093/jssam/smz058
DO - 10.1093/jssam/smz058
M3 - Review article
AN - SCOPUS:85112342009
VL - 9
SP - 477
EP - 495
JO - Journal of Survey Statistics and Methodology
JF - Journal of Survey Statistics and Methodology
SN - 2325-0984
IS - 3
ER -