This research investigated the effects of types and prevalence of response patterns that might be provided by nonattending respondents on Cronbach’s alpha. Three simulated data sets, one for each value of Cronbach’s alpha .700, .800, and .900, were constructed for 100 respondents on 50 one-to-seven Likert items. Participants were replaced randomly in each population by one of eight response patterns at 5%, 10%, 15%, and 20% replacement levels. Effects were greater as a function of increased prevalence in the respondent group; however, as few as 5% of certain types of nonattending patterns had strong, inflating effects on alpha.
Get full access to this article
View all access options for this article.
References
1.
Andrews, F. M. (1984). Construct validity and error components of survey measures: A structural modeling approach. Public Opinion Quarterly, 48(2), 409-422.
2.
Barnette, J. J. (1996). Responses that may indicate nonattending behaviors in three self-administered educational surveys. Research in the Schools, 3(2), 49-59.
3.
Bradburn, N. M. , & Sudman, S. (1991). The current status of questionnaire design. In P. P. Biemer, R. M. Groves, L. E. Lyberg, N. A. Mathiowetz, & S. Sudman (Eds.), Measurement errors in surveys (pp. 29-40). New York: John Wiley.
4.
Cronbach, L. J. (1970). Essentials of psychological testing (3rd ed.). New York: Harper & Row.
5.
Goldsmith, R. E. (1986). Personality and uninformed response error. Journal of Social Psychology, 126, 37-45.
6.
Goldsmith, R. E. (1988). Spurious response error in a new product survey. Journal of Business Research, 17, 271-281.
7.
Goldsmith, R. E. (1989). Reducing spurious response in a field survey. Journal of Social Psychology, 129, 201-212.
8.
Groves, R. M. (1991). Measurement error across the disciplines. In P. P. Biemer, R. M. Groves, L. E. Lyberg, N. A. Mathiowetz, & S. Sudman (Eds.), Measurement errors in surveys (pp. 1-25). New York: John Wiley.
9.
Nunnally, J. C. (1967). Psychometric theory. New York: McGraw-Hill.
Reinhardt, B. (1996). Factors affecting coefficient alpha: A mini Monte Carlo study. In B. Thompson (Ed.), Advances in social sciences methodology (Vol. 4, pp. 3-20). Greenwich, CT: JAI.
12.
SAS. (1990). Cary, NC: SAS Institute.
13.
Thompson, B. (1994). Guidelines for authors. Educational and Psychological Measurement, 54, 837-847.
14.
Vacha-Haase, T. (1998). Reliability generalization: Exploring variance in measurement error affecting score reliability across studies. Educational and Psychological Measurement, 58,6-20.
15.
Wentland, E. J. , & Smith, K. W. (1993). Survey responses: An evaluation of their validity. San Diego: Academic Press.
