Objective: To use anchoring vignettes to evaluate reporting heterogeneity (RH) in self-rated mobility and cognition in older adults. Method: We analyzed vignettes and self-rated mobility and cognition in 2,558 individuals aged 50 years and above. We tested for assumptions of vignette equivalence (VE) and response consistency (RC). We used a joint hierarchical ordered probit (HOPIT) model to evaluate self-rating responses for RH. Results: The assumption of VE was met except for “learning” vignettes. Higher socioeconomic status (SES) and education significantly lowered thresholds for cognition ratings. After correction for RH, women, lower SES, and older respondents were significantly more likely to report greater difficulty in mobility. The influence of age, SES, and education on thresholds was less apparent for cognition. Discussion: Our study provides strong evidence of RH in self-rated mobility and cognition. We highlight the need to formally test basic assumptions before using vignettes to adjust self-rating responses for RH.
Bago d’UvaT.LindeboomM.O’DonnellO.van DoorslaerE. (2011). Slipping anchor? Testing the vignettes approach to identification and correction of reporting heterogeneity. Journal of Human Resources, 46, 875-906.
2.
Bago d’UvaT.O’DonnellO.van DoorslaerE. (2008). Differential health reporting by education level and its impact on the measurement of health inequalities among older Europeans. International Journal of Epidemiology, 37, 1375-1383.
3.
Bago d’UvaT.Van DoorslaerE.LindeboomM.O’DonnellO. (2008). Does reporting heterogeneity bias the measurement of health disparities?Health Economics, 17, 351-375.
4.
BanksJ.MarmotM.OldfieldZ.SmithJ. P. (2007). The SES health gradient on both sides of the Atlantic. In WiseD. A. (Ed.), Developments in the economics of aging (pp. 359-406). Chicago, IL: University of Chicago Press.
5.
BradyH. E. (1985). The perils of survey research: Interpersonally incomparable responses. Political Methodology, 11, 269-290.
6.
ChristensenK.HerskindA. M.VaupelJ. W. (2006). Why Danes are smug: Comparative study of life satisfaction in the European Union. British Medical Journal, 333, 1289-1291.
7.
Datta GuptaN.KristensenN.PozzoliD. (2010). External validation of the use of vignettes in cross-country health studies. Economic Modelling, 27(4), 854-865.
8.
DeSalvoK. B.BloserN.ReynoldsK.HeJ.MuntnerP. (2006). Mortality prediction with a single general self-rated health question: A meta-analysis. Journal of General Internal Medicine, 21, 267-275.
9.
DowdJ. B.ZajacovaA. (2007). Does the predictive power of self-rated health for subsequent mortality risk vary by socioeconomic status in the US?International Journal of Epidemiology, 36, 1214-1221.
10.
FrankenbergE.JonesN. R. (2004). Self-rated health and mortality: Does the relationship extend to a low income setting?Journal of Health and Social Behavior, 45, 441-452.
11.
GillT. M.DesaiM. M.GahbauerE. A.HolfordT. R.WilliamsC. S. (2001). Restricted activity among community-living older persons: Incidence, precipitants, and health care utilization. Annals of Internal Medicine, 135, 313-321.
12.
Grol-ProkopczykH. (2010). Age, sex and race effects in anchoring vignette studies: Methodological and empirical contributions (CDE Working Paper No. 2010-18). Unpublished manuscript.
13.
Grol-ProkopczykH.FreeseJ.HauserR. M. (2011). Using anchoring vignettes to assess group differences in general self-rated health. Journal of Health and Social Behavior, 52, 246-261.
14.
HirveS.Gomez-OliveX.OtiS.DebpuurC.JuvekarS.TollmanS.. . . NgN. (2012). Use of anchoring vignettes to evaluate health reporting behavior amongst adults aged 50 years and above in Africa and Asia—Testing assumptions. Global Health Action, 6, Article 21064.
15.
HopkinsD. J.KingG. (2010). Improving anchoring vignettes: Designing surveys to correct interpersonal incomparability. Public Opinion Quarterly, 74, 201-222.
16.
JurgesH. (2007). True health vs response styles: Exploring cross-country differences in self-reported health. Health Economics, 16, 163-178.
17.
KapteynA.SmithJ.Van SoestA. (2007). Vignettes and self-reports of work disability in the US and the Netherlands. American Economic Review, 97, 461-473.
18.
KingG.MurrayC. J.SalomonJ. A.TandonA. (2004). Enhancing the validity and cross-cultural comparability of measurement in survey research. American Political Science Review, 98, 191-207.
19.
KingG.WandJ. (2007). Comparing incomparable survey responses: Evaluating and selecting anchoring vignettes. Political Analysis, 15, 46-66.
20.
KowalP.ChatterjiS.NaidooN.BiritwumR.FanW.Lopez RidauraR.. . . BoermaJ. T. (2012). Data resource profile: The World Health Organization Study on global AGEing and adult health (SAGE). International Journal of Epidemiology, 41, 1639-1649.
21.
KristensenN.JohanssonE. (2008). New evidence on cross-country differences in job satisfaction using anchoring vignettes. Labor Economics, 15, 96-117.
22.
LindeboomM.van DoorslaerE. (2004). Cut-point shift and index shift in self-reported health. Journal of Health Economics, 23, 1083-1099.
23.
MenecV. H.ShooshtariS.LambertP. (2007). Ethnic differences in self-rated health among older adults: A cross-sectional and longitudinal analysis. Journal of Aging and Health, 19, 62-86.
24.
MurrayC. J.TandonA.SalomonJ. A.MathersC. D.SadanaR. (2002). New approaches to enhance cross-population comparability of survey results. In MurrayC. J.SalomonJ. A. (Eds.), Summary measures of population health: Concepts, ethics, measurement and applications (pp. 421-432). Geneva, Switzerland: World Health Organization.
25.
ReedB. R.JagustW. J.SeabJ. P. (1989). Mental status as a predictor of daily function in progressive dementia. The Gerontologist, 29, 804-807.
26.
RiceN.RoboneS.SmithP. C. (2010). International comparison of public sector performance: The use of anchoring vignettes to adjust self-reported data. Evaluation, 16, 81-101.
27.
ShetterlyS. M.BaxterJ.MasonL. D.HammanR. F. (1996). Self-rated health among Hispanic vs non-Hispanic white adults: The San Luis Valley Health and Aging Study. American Journal of Public Health, 86, 1798-1801.
28.
TandonA.MurrayC. J.SalomonJ. A.KingG. (2003). Statistical models for enhancing cross-population comparability. In MurrayC. J.EvansD. B. (Eds.), Health systems performance assessment: Debates, methods and empiricism (pp. 727-746). Geneva, Switzerland: World Health Organization.
29.
Van SoestA.DelaneyC.HarmonC.KapteynA.SmithJ. (2007, June). Validating the use of vignettes for subjective threshold scales (IZA Discussion Paper No. 2860). Institute for the Study of Labor, Bonn, Germany. Retrieved from http://ftp.iza.org/dp2860.pdf
30.
ZimmerZ.NatividadJ.LinH. S.ChayovanN. (2000). A cross-national examination of the determinants of self-assessed health. Journal of Health and Social Behavior, 41, 465-481.
