A permutation procedure to compute a resampling probability value and empirical quantile limits is provided for Cronbach's alpha measure of internal reliability. The underlying assumptions for the conventional use of alpha are discussed. The use of a permutation test for Cronbach's alpha is highlighted as a valuable tool when sample sizes are small and necessary assumptions cannot be met.
Get full access to this article
View all access options for this article.
References
1.
BonettD. G. (2002) Sample size requirements for testing and estimating coefficient alpha. Journal of Educational and Behavioral Statistics, 27,335–340.
2.
CortinaJ. M. (1993) What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology, 78,98–104.
3.
CronbachL. J. (1951) Coefficient alpha and the internal structure of tests. Psychometrika, 16,297–334.
4.
CronbachL. J.ShavelsonR. J. (2004) My current thoughts on coefficient alpha and successor procedures. Educational and Psychological Measurement, 64,391–418.
FeldtL. S. (1965) The approximate sampling distribution of Kuder-Richardson reliability coefficient twenty. Psychometrika, 30,357–370.
7.
FeldtL. S.WoodruffD. J.SalihF. A. (1987) Statistical inference for coefficient alpha. Applied Psychological Measurement, 11,93–103.
8.
GroggelD. J.WackerlyD. D.RaoP. V. (1988) Nonparametric estimation in one-way random effects models. Communication in Statistics—Computation and Simulation, 17,887–903.
9.
HayesA. F. (1996) Permustat: Randomization tests for the Macintosh. Behavior Research Methods, Instruments, & Computers, 28,473–475.
10.
HoytC. (1941) Test reliability estimated by analysis of variance. Psychometrika, 6,153–160.
11.
IacobucciD.DuhachekA. (2003) Advancing alpha: Measuring reliability with confidence. Journal of Consumer Psychology, 13,478–487.
12.
JohnstonJ. E.BerryK. J.MielkeP. W. (2007) Permutation tests: Precision in estimating probability values. Perceptual and Motor Skills, 105,915–920.
13.
KistnerE. O.MüllerK. E. (2004) Exact distributions of intraclass correlation and Cron-bach's alpha with Gaussian data and general covariance. Psychometrika, 28,221–238.
14.
KristofW. (1963) The statistical theory of stepped-up reliability coefficients when a test has been divided into several equivalent parts. Psychometrika, 28,221–238.
15.
KuderG. F.RichardsonM. W. (1937) The theory of the estimation of test reliability. Psychometrika, 2,151–160.
16.
LevensonH. (1981) Differentiating among internality, powerful others, and chance. In LefcourtH. M. (Ed.), Research with the locus of control construct. Vol. 1. New York: Academic Press. Pp 15–63.
17.
LordF. M.NovickM. R. (1968) Statistical theories of mental test scores. Reading, MA: Addison-Wesley.
18.
MicceriT. (1989) The unicorn, the normal curve, and other improbable creatures. Psychological Bulletin, 105,156–166.
19.
MielkeP. W.Jr.BerryK. J. (2007) Permutation methods: A distance function approach. (2nd ed.) New York: Springer-Verlag.
20.
NovickM. R.LewisC. (1967) Coefficient alpha and the reliability of composite measurements. Psychometrika, 32,1–13.
21.
PetersonR. A. (1994) A meta-analysis of Cronbach's coefficient alpha. The Journal of Consumer Research, 21,381–391.
22.
ShevlinM.MilesJ. N. V.DaviesM. N. O.WalkerS. (2000) Coefficient alpha: A useful indicator of reliability?Personality and Individual Differences, 28,229–237.
23.
ShroutP. E.FleissJ. L. (1979) Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86,420–428.
24.
van ZylJ. M.NeudeckerH.NelD. G. (2000) On the distribution of the maximum likelihood estimator of Cronbach's alpha. Psychometrika, 65,271–280.
25.
ZimmermanD. W.ZumboB. D.LalondeC. (1993) Coefficient alpha as an estimate of test reliability under the violation of two assumptions. Educational and Psychological Measurement, 53,33–49.
