The impact of outliers on Cronbach's coefficient α has not been documented in the psychometric or statistical literature. This is an important gap because coefficient α is the most widely used measurement statistic in all of the social, educational, and health sciences. The impact of outliers on coefficient α is investigated for varying values of population reliability and sample sizes for visual analogue scales. Results show that coefficient α is not affected by symmetric outlier contamination, whereas asymmetric outliers artificially inflate the estimates of coefficient α. Coefficient α estimates are upwardly biased and more variable sample to sample, with increasing asymmetry and proportion of outlier contamination in the population. However, these effects of outliers on the bias and sample variability of coefficient α estimates are reduced for increasing population reliability. The results are discussed in the context of providing guidance for computing or interpreting coefficient α for visual analogue scales.
Barnett, V. (1978). The study of outliers: Purpose and model . Applied Statistics, 27, 242-250 .
4.
Barnett, V. , & Lewis, T. (1993). Outliers in statistical data (3rd ed.). New York: John Wiley .
5.
Barnette, J. (1999). Nonattending respondent effects on the internal consistency of self-administered surveys: A Monte Carlo simulation study . Educational and Psychological Measurement, 59, 38-46 .
Blair, R.C. , & Higgins, J.J. (1980). The power of t and Wilconxon statistics: A comparison . Evaluation Review, 4, 645-656 .
8.
Blair, R.C. , & Higgins, J.J. (1981). A note on the asymptotic relative efficiency of the Wilcoxon rank-sum test relative to the independent means t test under mixtures of low normal distributions . British Journal of Mathematical and Statistical Psychology, 34, 124-128 .
9.
Bradley, J.V. (1980). Nonrobustness in Z, t, and F tests at large sample sizes . Bulletin of the Psychonomic Society, 16, 333-336 .
10.
Chatterjee, S. , & Hadi, A.S. (1986). Influential observations, high leverage points, and outliers in linear regression . Statistical Science, 1, 209-227 .
11.
Cohen, J. (1973). Eta-squared and partial eta-squared in fixed factor ANOVA designs . Educational and Psychological Measurement, 33, 107-112 .
12.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Hillsdale, NJ: Lawrence Erlbaum .
13.
Cook R.D. , & Weisberg, S. (1980). Characterizations of an empirical influence function for detecting influential cases in regression . Technometrics , 22, 495-507 .
14.
Cortina, J.M. (1993). What is coefficient alpha: An examination of theory and applications . Journal of Applied Psychology, 78, 98-104 .
15.
Cronbach, L.J. (1951). Coefficient alpha and the internal structure of tests . Psychometrika, 12, 1-16 .
16.
Cronbach, L.J. (2004). My current thoughts on coefficient alpha and successor procedures . Educational and Psychological Measurement, 64, 391-418 .
17.
Draper N.R. , & Smith, H. (1981). Applied regression analysis (2nd ed.). New York: John Wiley .
18.
Freund, J.E. , & Walpole, R.E. (1980). Mathematical statistics (3rd ed.). New Jersey: Prentice Hall .
19.
Gelin, M.N. , Beasley, T.M. , & Zumbo, B.D. (2003, April). What is the impact on scale reliability and exploratory factor analysis of a Pearson correlation matrix when some respondents are not able to follow the rating scale ? Paper presented at the annual meeting of the American Educational Research Association (AERA), Chicago, IL.
20.
Henrysson, S. , & Wedman, I. (1972). Analysis of the inter-item covariance matrix . Scandinavian Journal of Educational Research, 16, 25-35 .
Huber, P.J. (1964). Robust estimation of a location parameter . Annals of Mathematical Statistics, 35, 73-101 .
23.
Huber, P.J. (1972). Robust statistics: A review . Annals of Mathematical Statistics, 43, 1041-1067 .
24.
Huber, P.J. (1973). Robust regression: Asymptotics, conjectures and Monte Carlo . Annals of Statistics, 1, 799-821 .
25.
Huber, P.J. (1981). Robust statistics. New York : John Wiley .
26.
Jöreskog, K.G. (1971). Statistical analysis of sets of congeneric tests . Psychometrika, 36, 109-133 .
27.
Lind, J.C. , & Zumbo, B.D. (1993). The continuity principle in psychological research: An introduction to robust statistics . Canadian Psychology , 34, 407-412 .
28.
Mosteller, F. , & Tukey, J.W. (1968). Data analysis, including statistics. In G. Lindzey & E. Aronson (Eds.), The handbook of social psychology: Vol. 2. Research methods (pp. 80-203). Reading, MA: Addison-Wesley .
29.
Novick, M.R. , & Lewis, M.R. (1967). Coefficient alpha and the reliability of composite measurements . Psychometrika, 32, 1-13 .
30.
Pellegrini, E.K. , & Scandura, T.A. (2005). Construct equivalence across groups: An unexplored issue in mentoring research . Educational and Psychological Measurement, 65, 323-335 .
31.
Reuterberg, S.E. , & Gustafsson, J.E. (1992). Confirmatory factor analysis and reliability: Testing measurement model assumptions . Educational and Psychological Measurement, 52, 795-811 .
32.
Slocum, S.L. (2005). Assessing unidimensionality of psychological scales: Using individual and integrative criteria from factor analysis. Unpublished doctoral dissertation, University of British Columbia , Canada.
33.
Stevens, J.P. (1984). Outliers and influential data points in regression analysis . Psychological Bulletin,95, 334-344 .
34.
Tukey, J.W. (1960). A survey of sampling from contaminated distributions . In I. Olkin , S. G. Ghury , W. Hoeffding , W. G. Madow , and H. B. Mann (Eds.), Contributions to probability and statistics (pp. 448-485). Palo Alto, CA: Stanford University Press .
35.
Wilcox, R.R. (1992). Robust generalizations of classical test reliability and Cronbach's alpha . British Journal of Mathematical and Statistical Psychology, 45, 239-254 .
36.
Wilcox, R.R. (1998). How many discoveries have been lost by ignoring modern statistical methods?American Psychologist, 53, 300-314 .
37.
Wilcox, R.R. (2005). Introduction to robust estimation and hypothesis testing (2nd ed.). San Diego, CA: Academic Press .
38.
Zimmerman, D.W. , Zumbo, B.D. , & Lalonde, C. (1993). Coefficient alpha as an estimate of test reliability under violation of two assumptions . Educational and Psychological Measurement, 53, 33-49 .
39.
Zumbo, B.D. (1994). The lurking assumptions in using generalizability theory to monitor an individual's progress. In D. Laveault , B. D. Zumbo , M. E. Gessaroli , & M. Boss , (Eds.), Modern theories of measurement: Problems & issues (pp. 261-278). Ottawa , Canada: University of Ottawa .
40.
Zumbo, B.D. , & Jennings, M.J. (2002). The robustness of validity and efficiency of the related samples t-test in the presence of outliers . Psicologica, 23, 415-450 .
41.
Zumbo, B.D. , & Ochieng, C.O. (2003, April). The impact of Likert or rating scale mis-responding (differential responding) on commonly used statistical methods: An overview of the symposium and the methodology . Paper presented at the annual meeting of the American Educational Research Association (AERA) , Chicago, IL.
