Improving Vignette Descriptions and Question Formats to Measure Distance Vision

Abstract

Vignette design has been largely neglected in anchoring vignette studies. This study aimed to contribute to the science of vignette design by developing and evaluating vignettes for measuring vision in rural China. Cognitive interviews were conducted among 36 participants in a Chinese middle school. The respondents either directly evaluated vision of the vignette character (i.e., noncomparative judgment) or compared their own vision with that of the vignette character (i.e., comparative judgment). It was found that a hypothetical person in the vignette was successfully envisioned by participants in grade 7 and beyond. However, more than half the participants were unable to accurately estimate distances expressed in meters. Some participants were critical in self-evaluation, yet tolerant of others’ performance. Participants more easily produced an answer and had greater confidence in the answer in comparative judgment than for noncomparative judgment. We conclude with recommendations for designing concise and complete vignettes and suggest the use of comparative rather than noncomparative judgment.