Details
| Original language | English |
|---|---|
| Pages (from-to) | 269-275 |
| Number of pages | 7 |
| Journal | International Journal of Social Research Methodology |
| Volume | 25 |
| Issue number | 2 |
| Early online date | 18 Jan 2021 |
| Publication status | Published - 4 Mar 2022 |
| Externally published | Yes |
Abstract
Previous research has shown that question characteristics, such as the shape of rating scales, can affect how respondents interpret and respond to questions. For example, earlier studies reported different response distributions for questions employing rating scales in the form of a ladder and in the form of a pyramid. The current experiment, implemented in a probability-based online panel (N = 4,377), re-visits and extends this research by examining how the two graphical layouts (ladder vs. pyramid) affect response behavior and data quality of a question on subjective social stratification. In line with the earlier results, we found that respondents rated their social status lower in the pyramid than in the ladder condition. No differences between the two layouts were found regarding response effort, however, the ladder layout was associated with higher criterion validity. Therefore, we recommend employing the ladder layout when measuring subjective social stratification.
Keywords
- Data quality, pragmatic response effect, rating scale design, response behavior, response effort
ASJC Scopus subject areas
- Social Sciences(all)
- General Social Sciences
Cite this
- Standard
- Harvard
- Apa
- Vancouver
- BibTeX
- RIS
In: International Journal of Social Research Methodology, Vol. 25, No. 2, 04.03.2022, p. 269-275.
Research output: Contribution to journal › Article › Research › peer review
}
TY - JOUR
T1 - Measuring subjective social stratification
T2 - how does the graphical layout of rating scales affect response distributions, response effort, and criterion validity in web surveys?
AU - Lenzner, Timo
AU - Höhne, Jan Karem
N1 - Funding Information: We acknowledge funding by the German Science Foundation through the Collaborative Research Center 884 ‘Political Economy of Reforms’ at the University of Mannheim, Germany (grant number: 139943784). The authors are grateful to Tobias Rettig (University of Mannheim) for his great support during and after data collection.
PY - 2022/3/4
Y1 - 2022/3/4
N2 - Previous research has shown that question characteristics, such as the shape of rating scales, can affect how respondents interpret and respond to questions. For example, earlier studies reported different response distributions for questions employing rating scales in the form of a ladder and in the form of a pyramid. The current experiment, implemented in a probability-based online panel (N = 4,377), re-visits and extends this research by examining how the two graphical layouts (ladder vs. pyramid) affect response behavior and data quality of a question on subjective social stratification. In line with the earlier results, we found that respondents rated their social status lower in the pyramid than in the ladder condition. No differences between the two layouts were found regarding response effort, however, the ladder layout was associated with higher criterion validity. Therefore, we recommend employing the ladder layout when measuring subjective social stratification.
AB - Previous research has shown that question characteristics, such as the shape of rating scales, can affect how respondents interpret and respond to questions. For example, earlier studies reported different response distributions for questions employing rating scales in the form of a ladder and in the form of a pyramid. The current experiment, implemented in a probability-based online panel (N = 4,377), re-visits and extends this research by examining how the two graphical layouts (ladder vs. pyramid) affect response behavior and data quality of a question on subjective social stratification. In line with the earlier results, we found that respondents rated their social status lower in the pyramid than in the ladder condition. No differences between the two layouts were found regarding response effort, however, the ladder layout was associated with higher criterion validity. Therefore, we recommend employing the ladder layout when measuring subjective social stratification.
KW - Data quality
KW - pragmatic response effect
KW - rating scale design
KW - response behavior
KW - response effort
UR - http://www.scopus.com/inward/record.url?scp=85099570309&partnerID=8YFLogxK
U2 - 10.1080/13645579.2021.1874607
DO - 10.1080/13645579.2021.1874607
M3 - Article
AN - SCOPUS:85099570309
VL - 25
SP - 269
EP - 275
JO - International Journal of Social Research Methodology
JF - International Journal of Social Research Methodology
SN - 1364-5579
IS - 2
ER -