Many survey researchers believe that the quality of answers to attitude questions may be improved by using no-opinion filters to remove those responses that are not based on true opinions. The authors investigate whether reliability, one aspect of data quality, is greater for filtered questions. Split-ballot experiments from two telephone surveys of the Akron, Ohio metropolitan area are used to estimate the effect of filtered questions on the reliability of items from Srole's anomia scale, Rosenberg's self-esteem scale, and a scale of attitudes toward lawyers. There is no evidence that filtered questions improve reliability, and in the case of self-esteem, reliability may be reduced on the filtered form.
Get full access to this article
View all access options for this article.
References
1.
Alwin, Duane F.1989. “Problems in the Estimation and Interpretation of the Reliability of Survey Data.”Quality and Quantity23:277-331.
2.
Alwin, Duane F.1991. “Research on Survey Quality.”Sociological Methods & Research20:3-29.
3.
Alwin, Duane F.
and David J. Jackson. 1979. “Measurement Models for Response Errors in Surveys: Issues and Applications.” Pp. 68-119 in Sociological Methodology 1980, edited by K. F. Schuessler. San Francisco: Jossey-Bass.
4.
Alwin, Duane F.
and David J. Jackson. 1981. “Applications of Simultaneous Factor Analysis to Issues of Factorial Invariance.” Pp. 249-279 in Factor Analysis and Measurement in Sociological Research, edited by D. J. Jackson and E. F. Borgatta. London: Sage.
5.
Alwin, Duane F.
and Jon A. Krosnick. 1991. “The Reliability of Attitudinal Survey Measures: The Role of Question and Respondent Characteristics.”Sociological Methods & Research20:139-181.
6.
Andrews, Frank M.1984. “Construct Validity and Error Components of Survey Measures: A Structural Modeling Approach.”Public Opinion Quarterly48:409-442.
7.
Bishop, George F.
, R. W. Oldendick, and A. J. Tuchfarber. 1983. “Effects of Filter Questions in Public Opinion Surveys.”Public Opinion Quarterly47:528-546.
8.
Bogart, Leo
. 1967. “No Opinion, Don't Know, and Maybe No Answer.”Public Opinion Quarterly31:331-345.
9.
Bollen, Kenneth
. 1989. Structural Equations With Latent Variables. New York: Wiley.
10.
Converse, Jean M.1976-1977. “Predicting `No Opinion' in the Polls.”Public Opinion Quarterly40:515-530.
11.
Converse, Phillip E.
1964. “The Nature of Belief Systems in the Mass Public.” Pp. 206-261 in Ideology and Discontent, edited by D. D. Apter. New York: Free Press.
12.
Grice, H. P.
1975. “Logic and Conversation.” Pp. 41-58 in Syntax and Semantics: Speech Acts, vol. 3, edited by P. Cole and J. L. Morgan. New York: Academic Press.
13.
Heise, David R.
and George W. Bohrnstedt. 1970. “Validity, Invalidity, and Reliability.” Pp. 104-138 in Sociological Methodology 1970, edited by E. F. Borgatta. San Francisco: Jossey-Bass.
14.
Hippler, Hans-J.
and Norbert Schwarz. 1989. “No Opinion Filters: A Cognitive Perspective.”International Journal of Public Opinion Research1:77-87.
15.
Jöreskog, Karl G.
and Dag Sörbom. 1989. LISREL 7 User's Reference Guide. Mooresville, IN: Scientific Software, Inc.
16.
Lord, F. M.
and M. R. Novick. 1968. Statistical Theories of Mental Test Scores. Reading, MA: Addison-Wesley.
17.
McClendon, McKee J.1986. “Unanticipated Effects of No-Opinion Filters on Attitudes and Attitude Strength.”Sociological Perspectives29:379-395.
18.
McClendon, McKee J.1991. “Acquiescence and Recency Response-Order Effects in Attitude Surveys.”Sociological Methods & Research20:60-103.
19.
Mirowsky, John
and Catherine E. Ross. 1991. “Eliminating Defense and Agreement Bias from Measures of the Sense of Control: A 2 × 2 Index.”Social Psychology Quarterly54:127-145.
20.
Rosenberg, Morris
. 1965. Society and the Adolescent Self-Image. Princeton, NJ: Princeton University Press.
21.
Srole, Leo
. 1956. “Social Integration and Certain Corollaries: An Exploratory Study.”American Sociological Review30:709-716.
22.
Schuman, Howard
and Stanley Presser. 1981. Questions and Answers in Attitude Surveys. New York: Academic Press.
