A latent variable modeling procedure that can be used to evaluate intraclass correlation coefficients in two-level settings with discrete response variables is discussed. The approach is readily applied when the purpose is to furnish confidence intervals at prespecified confidence levels for these coefficients in setups with binary or ordinal outcome measures and nesting of subjects within higher order units. The method can aid educational and behavioral researchers in their study of sources of observed outcome variability and model choice considerations in multilevel settings, and is illustrated with empirical survey data.
HamiltonL. C. (2012). Statistics with Stata: Version 12 (8th ed.). College Station, TX: Stata Corp.
2.
MuthénL. K.MuthénB. O. (2014). Mplus user’s guide. Los Angeles, CA: Muthén & Muthén.
3.
Rabe-HeskethS.SkrondalA. (2012). Multilevel and longitudinal modeling using Stata. College Station, TX: Stata Corp.
4.
RaudenbushS. W.BrykA. S. (2002). Hierarchical linear models. Applications and data analysis methods (2nd ed.). Thousand Oaks, CA: Sage.
5.
RaudenbushS. W.Xiao-FengL. (2001). Effects of study duration, frequency of observation, and sample size on power in studies of group differences in polynomial change. Psychological Methods, 6, 387-401.
6.
RaykovT. (2011). Intra-class correlation coefficients in hierarchical designs: Evaluation using latent variable modeling. Structural Equation Modeling, 18, 73-90.
7.
RaykovT.MarcoulidesG. A. (2004). Using the delta method for approximate interval estimation of parametric functions in covariance structure models. Structural Equation Modeling, 11, 659-675.
8.
RaykovT.MarcoulidesG. A. (2011). Introduction to psychometric theory. New York, NY: Taylor & Francis.
9.
RaykovT.MarcoulidesG. A. (2015). On examining the underlying normal variable assumption in latent variable models with categorical indicators. Structural Equation Modeling, 22, 581-587.
10.
SchmidtF. L. (1996). Statistical significance testing and cumulative knowledge in psychology: Implications for the training of researchers. Psychological Methods, 1, 115-129.
11.
SnijdersT. A. B.BoskerR. (2012). Multilevel analysis. Thousand Oaks, CA: Sage.
