Details
| Original language | English |
|---|---|
| Pages (from-to) | 193-204 |
| Number of pages | 12 |
| Journal | Survey research methods |
| Volume | 17 |
| Issue number | 2 |
| Publication status | Published - 8 Aug 2023 |
Abstract
Survey questions with rating scales are a common method in attitude measurement. Similar to other scale characteristics, scale direction and its effects on answer behavior and data quality deserves special attention. This particularly applies to scale direction effects across different scale lengths. In order to contribute to the current state of research, we investigate scale direction effects across scales with five and seven points by analyzing observed and latent answer distributions including composite reliabilities. We conducted an experiment in the probability-based German Internet Panel (N = 4676) using questions on achievement and job motivation that vary scale direction (i.e., decremental and incremental) and scale length (i.e., five and seven points). The results reveal differences between scales with five and seven points. Five-point scales are more robust against scale direction effects than their seven-point counterparts. In ad-dition, decremental and incremental scales with five points are invariant. This does not apply to decremental and incremental scales with seven points. However, composite reliabilities are higher for scales with seven points than for scales with five points. This is irrespective of the scale direction.
Keywords
- Composite reliabilities, Data quality, Latent means, Measurement invariance, Online survey, Scale direction effects, Survey-satisficing
ASJC Scopus subject areas
- Social Sciences(all)
- Education
Cite this
- Standard
- Harvard
- Apa
- Vancouver
- BibTeX
- RIS
In: Survey research methods, Vol. 17, No. 2, 08.08.2023, p. 193-204.
Research output: Contribution to journal › Article › Research › peer review
}
TY - JOUR
T1 - Investigating direction effects in rating scales with five and seven points in a probability-based online panel
AU - Höhne, Jan Karem
AU - Krebs, Dagmar
AU - Kühnel, Steffen M.
PY - 2023/8/8
Y1 - 2023/8/8
N2 - Survey questions with rating scales are a common method in attitude measurement. Similar to other scale characteristics, scale direction and its effects on answer behavior and data quality deserves special attention. This particularly applies to scale direction effects across different scale lengths. In order to contribute to the current state of research, we investigate scale direction effects across scales with five and seven points by analyzing observed and latent answer distributions including composite reliabilities. We conducted an experiment in the probability-based German Internet Panel (N = 4676) using questions on achievement and job motivation that vary scale direction (i.e., decremental and incremental) and scale length (i.e., five and seven points). The results reveal differences between scales with five and seven points. Five-point scales are more robust against scale direction effects than their seven-point counterparts. In ad-dition, decremental and incremental scales with five points are invariant. This does not apply to decremental and incremental scales with seven points. However, composite reliabilities are higher for scales with seven points than for scales with five points. This is irrespective of the scale direction.
AB - Survey questions with rating scales are a common method in attitude measurement. Similar to other scale characteristics, scale direction and its effects on answer behavior and data quality deserves special attention. This particularly applies to scale direction effects across different scale lengths. In order to contribute to the current state of research, we investigate scale direction effects across scales with five and seven points by analyzing observed and latent answer distributions including composite reliabilities. We conducted an experiment in the probability-based German Internet Panel (N = 4676) using questions on achievement and job motivation that vary scale direction (i.e., decremental and incremental) and scale length (i.e., five and seven points). The results reveal differences between scales with five and seven points. Five-point scales are more robust against scale direction effects than their seven-point counterparts. In ad-dition, decremental and incremental scales with five points are invariant. This does not apply to decremental and incremental scales with seven points. However, composite reliabilities are higher for scales with seven points than for scales with five points. This is irrespective of the scale direction.
KW - Composite reliabilities
KW - Data quality
KW - Latent means
KW - Measurement invariance
KW - Online survey
KW - Scale direction effects
KW - Survey-satisficing
UR - http://www.scopus.com/inward/record.url?scp=85167903913&partnerID=8YFLogxK
U2 - 10.18148/srm/2023.v17i2.8006
DO - 10.18148/srm/2023.v17i2.8006
M3 - Article
AN - SCOPUS:85167903913
VL - 17
SP - 193
EP - 204
JO - Survey research methods
JF - Survey research methods
SN - 1864-3361
IS - 2
ER -