Sage Journals: Discover world-class research

Abstract

The population discrepancy between unstandardized and standardized reliability of homogeneous multicomponent measuring instruments is examined. Within a latent variable modeling framework, it is shown that the standardized reliability coefficient for unidimensional scales can be markedly higher than the corresponding unstandardized reliability coefficient, or alternatively substantially lower than the latter. Based on these findings, it is recommended that scholars avoid estimating, reporting, interpreting, or using standardized scale reliability coefficients in empirical research, unless they have strong reasons to consider standardizing the original components of utilized scales.

Keywords

congeneric tests congeneric test model measuring instrument reliability single-factor model standardized reliability coefficient unstandardized reliability coefficient

Get full access to this article

View all access options for this article.

References

Apostol

(2013). Calculus. Wiley.

Bentler

P. M.

Satorra

(2010). Testing model nesting and equivalence. Psychological Methods, 15(2), 111-123. https://doi.org/10.1037/a0019625

Bollen

K. A.

(1989). Structural equations with latent variables. Wiley. https://doi.org/10.1002/9781118619179

Casella

Berger

(2002). Statistical inference. Wadsworth.

Ferguson

T. S.

(1996). A course in large sample theory. Chapman & Hall. https://doi.org/10.1007/978-1-4899-4549-5

Jöreskog

K. G.

(1971). Statistical analysis of sets of congeneric tests. Psychometrika, 36(2), 109-133. https://doi.org/10.1007/BF02291393

Jöreskog

K. G.

Sörbom

(1996). LISREL 8 user’s guide. Scientific Software.

McDonald

R. P.

(1999). Test theory. A unified treatment. Lawrence Erlbaum.

McNeish

(2018). Thanks coefficient alpha, we’ll take it from here. Psychological Methods, 23(3), 412-433. https://doi.org/10.1037/met0000144

10.

Muthén

L. K.

Muthén

B. O.

(2018). Mplus user’s guide. Muthén & Muthén.

11.

Raykov

(2012). Scale development using structural equation modeling. In Hoyle

(Ed.), Handbook of structural equation modeling (pp. 472-492). Guilford Press.

12.

Raykov

(2019). Strong consistency of reliability estimators for multiple-component measuring instruments. Structural Equation Modeling, 26(5), 750-756. https://doi.org/10.1080/10705511.2018.1559737

13.

Raykov

Marcoulides

G. A.

(2004). Using the delta method for approximate interval estimation of parametric functions in covariance structure models. Structural Equation Modeling, 11(4), 659-675. https://doi.org/10.1207/s15328007sem1104_7

14.

Raykov

Marcoulides

G. A.

(2008). An introduction to applied multivariate analysis. Taylor & Francis. https://doi.org/10.4324/9780203809532

15.

Raykov

Marcoulides

G. A.

(2011). Introduction to psychometric theory. Taylor & Francis. https://doi.org/10.4324/9780203841624

16.

Raykov

Marcoulides

G. A.

(2019). Thanks coefficient alpha, we still need you! Educational and Psychological Measurement, 79(1), 200-210. https://doi.org/10.1177/0013164417725127

17.

Raykov

Marcoulides

G. A.

Chang

(2016). Studying population heterogeneity in finite mixture settings using latent variable modeling. Structural Equation Modeling, 23(5), 726-730. https://doi.org/10.1080/10705511.2015.1103193

18.

Raykov

Shrout

(2002). Reliability of scales with general structure: Point and interval estimation using a structural equation modeling approach. Structural Equation Modeling, 9(2), 195-212. https://doi.org/10.1207/S15328007SEM0902_3

19.

Zimmerman

D. W.

(1975). Probability spaces, Hilbert spaces, and the axioms of test theory. Psychometrika, 40(3), 395-412. https://doi.org/10.1007/BF02291765

On the Pitfalls of Estimating and Using Standardized Reliability Coefficients

Abstract

Keywords

Get full access to this article

References