Reliability generalization studies are increasingly frequently reported in the literature, including Mji and Alkhateeb's 2005 study of the Conceptions of Mathematics Questionnaire. The present article comments on an issue of reliability generalization as used in that study and clarifies a theoretical point regarding the meaning of coefficient alpha and what data features tend to influence it as a measure of score reliability.
Get full access to this article
View all access options for this article.
References
1.
CharterR. A. (2003) Combining reliability coefficients: Possible application to meta-analysis and reliability generalization. Psychological Reports, 93, 643–647.
2.
CrawfordK.GordonS.NicholasJ.ProsserM. (1998) University mathematics students' conceptions of mathematics. Studies in Higher Education, 23, 87–94.
3.
CrockerL.AlginaJ. (1986) Introduction to classical and modern test theory. Chicago, IL: Holt, Rinehart & Winston.
4.
CronbachL. J.ShavelsonR. J. (2004) My current thoughts on coefficient alpha and successor procedures. Educational and Psychological Measurement, 64, 391–418.
5.
HensonR. K. (2001) Understanding internal consistency reliability estimates: A conceptual primer on coefficient alpha. Measurement and Evaluation in Counseling and Development, 34, 177–189.
6.
HensonR. K.ThompsonB. (2002) Characterizing measurement error in scores across studies: Some recommendations for conducting “reliability generalization” studies. Measurement and Evaluation in Counseling and Development, 35, 113–127.
7.
MjiA.AlkhateebH. M. (2005) Combining reliability coefficients: Toward reliability generalization of the Conceptions of Mathematics Questionnaire. Psychological Reports, 96, 627–634.
8.
ShavelsonR.WebbN. M. (1991) Generalizability theory: A primer. Newbury Park, CA: Sage.
9.
ThompsonB.Vacha-HaaseT. (2000) Psychometrics is datametrics: The test is not reliable. Educational and Psychological Measurement, 60, 174–195.
10.
Vacha-HaaseT. (1998) Reliability generalization: Exploring variance in measurement error affecting score affecting score reliability across studies. Educational and Psychological Measurement, 58, 6–20.
11.
Vacha-HaaseT.HensonR. K.CarusoJ. C. (2002) Reliability generalization: Moving toward improved understanding and use of score reliability. Educational and Psychological Measurement, 62, 562–569.
