Sage Journals: Discover world-class research

Abstract

Surveys mainly use questions in which it is allowed to answer only through a closed series of alternatives. The choice of labels for these closed alternatives is an important decision. Depending on this choice, different results can be found. This paper focuses on the impact of using low versus high frequencies or durations scales. The novelty is that it studies panellists of an online panel oriented towards marketing surveys. Also, it uses data from countries little studied before: Spain, Mexico and Colombia. Using a split-ballot experimental design, it shows that significant differences in answers are obtained depending on the scale used. In order to determine which scale gives results closer to the reality, the correlation with an external variable is used; the higher this correlation, the better the scale. In practice, this information can and should be used to select the best scale for a survey.

Get full access to this article

View all access options for this article.

References

Berg

I.A.

, & Rapaport

G.M.

(1954) Response bias in an unstructured questionnaire. Journal of Psychology, 38, pp. 475–481.

Borgatta

, & Bohrnstedt

(1980) Level of measurement once over again. Sociological Methods & Research, 9, pp. 147–160.

Campbell

D.T.

, & Fiske

D.W.

(1959) Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 6, pp. 81–105.

Converse

J. M.

(1984) Strong arguments and weak evidence: the open/closed questioning controversy of the 1940s. Public Opinion Quarterly, 48, 1B, pp. 267–282.

Converse

(1964) The nature of belief systems in mass publics, in Apter

D. A.

(ed.) Ideology and Discontent. New York: Free Press, pp. 206–261.

Kreuter

, Presser

, & Tourangeau

(2008) Social desirability bias in CATI, IVR and web surveys: the effects of mode and question sensitivity. Public Opinion Quarterly, 72, 5, pp. 847–865.

Krosnick

J. A.

(1991) Response strategies for coping with the cognitive demands of attitude measures in surveys. Applied Cognitive Psychology, 5, pp. 213–236.

Krosnik

J.A.

, & Schuman

(1988) Attitude intensity, importance and certainty and susceptibility to response effects. Journal of Personality and Social Psychology, 54, pp. 940–952.

Labovitz

(1967) Some observations on measurement and statistics. Social Forces, 46, pp. 151–160.

10.

Labovitz

(1970) The assignment of numbers to rank order categories. American Sociological Review, 35, 3, pp. 515–524.

11.

Lazarsfeld

P. F.

(1944) The controversy over detailed interviews – an offer for negotiation. Public Opinion Quarterly, 8, 1, pp. 38–60.

12.

Saris

W.E.

, & Gallhofer

(2007) Design, Evaluation, and Analysis of Questionnaires for Survey Research. New York: Wiley.

13.

Schuman

, & Presser

(1981) Questions and Answers in Attitude Survey: Experiments on Question Form, Wording and Context. New York: Academic Press.

14.

Schwarz

, & Hippler

H.J.

(1987) What response scales may tell your respondents: informative functions of response alternatives, in Hippler

, Schwarz

, & Sudman

(eds) Social Information Processing and Survey Methodology. New York: Springer-Verlag.

15.

Schwarz

, & Hippler

H.J.

(1991) Response alternatives: the impact of their choice and order, in Biemer

, Groves

R.M.

, Mathiowetz

N.A.

, & Sudman

(eds) Measurement Errors in Surveys. Chichester: Wiley, pp. 41–56.

16.

Smyth

J.D.

, Dillman

D.A.

, Christian

L.M.

, & Stern

M.J.

(2006) Comparing check-all and forced-choice question formats in web surveys. Public Opinion Quarterly, 70, 1, pp. 66–77.

17.

Tourangeau

, & Smith

T.W.

(1996) Asking sensitive questions: the impact of data collection mode, question format, and question context. Public Opinion Quarterly, 60, 2, pp. 275–304.

18.

Tourangeau

, Rips

L.J.

, & Rasinski

(2000) The Psychology of Survey Response. Cambridge, MA: Cambridge University Press.

19.

Zaller

J. R.

(1992) The Nature and Origins of Mass Opinion. Cambridge: Cambridge University Press.

Effect of Using Different Labels for the Scales in a Web Survey

Abstract

Get full access to this article

References