A latent variable modeling procedure for studying factorial invariance and differential item functioning for multi-component measuring instruments with nominal items is discussed. The method is based on a multiple testing approach utilizing the false discovery rate concept and likelihood ratio tests. The procedure complements the Revuelta, Franco-Martinez, and Ximenez approach to factorial invariance examination, and permits localization of individual invariance violations. The outlined method does not require the selection of a reference observed variable and is illustrated with empirical data.
AgrestiA. (2002). Categorical data analysis. Wiley.
2.
BenjaminiY.HochbergY. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society, Series B, 57, 289–300.
3.
BockR. D. (1972). Estimating item parameters and latent ability when responses are scored in two or more nominal categories. Psychometrika, 37, 29–51.
4.
BockR. D. (1975). Multivariate statistical methods in behavioral research. McGraw-Hill.
5.
BollenK. A. (1989). Structural equations with latent variables. Wiley.
6.
BowenN. K.MasaR. D. (2015). Conducting measurement invariance tests with ordinal data. Journal of the Society for Social Work and Research, 6, 2334–2315.
7.
CheungG. W.RensvoldR. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233–255.
8.
DubravkaS.RutkowskiL.RutkowskiD. (2020). Multiple-group invariance with categorical outcomes using updated guidelines: An illustration using Mplus and the lavaan/semtools packages. Structural Equation Modeling, 27, 111–130.
9.
GerosaT. (2021). Measurement invariance with ordered categorical variables: Applications in longitudinal survey research. In CernatA.SakshautJ. W. (Eds.), Measurement error in longitudinal data. Oxford University Press.
10.
Huggins-ManleyA. C.AlginaJ. (2015). The partial credit model and generalized partial credit model as constrained nominal response models, with applications in Mplus. Structural Equation Modeling, 22, 308–318.
11.
LittleR. J. A.RubinD. B. (2020). Statistical analysis with missing data. Wiley.
12.
MaraunM.HeeneM. (2016). A note on the implications of factorial invariance for common factor variable equivalence. Communications in Statistics: Theory and Methods, 45, 4181–4193.
13.
MillsapR. E. (2011). Statistical approaches to measurement invariance. Taylor & Francis.
14.
MuthénL. K.MuthénB. O. (2024). Mplus user’s guide.
15.
NeringM. L.OstiniR. (2010). Handbook of polytomous item response theory models. Taylor & Francis.
16.
RaykovT. (2024). Measurement invariance is not sufficient for meaningful and valid group comparisons: A note on Robitzsch and Lüdtke. Structural Equation Modeling, 31, 494–497.
17.
RaykovT.DimitrovD. M.MarcoulidesG. A.LiT.MenoldN. (2018). Examining measurement invariance and differential item functioning with discrete latent constructs indicators: A note on a multiple testing procedure. Educational and Psychological Measurement, 78, 343–352.
18.
RaykovT.MarcoulidesG. A. (2018). A course in item response theory and modeling with Stata. Stata Press.
19.
RaykovT.MarcoulidesG. A.HarrisonM.ZhangM. (2020). On the dependability of a popular procedure for studying measurement invariance: A cause for concern?Structural Equation Modeling, 27, 649–656.
20.
RaykovT.MarcoulidesG. A.LeeC.-L.ChangD. C. (2013). Studying differential item functioning via latent variable modeling: A note on a multiple testing procedure. Educational and Psychological Measurement, 73, 898–908.
21.
RaykovT.MarcoulidesG. A.MillsapR. E. (2013). Examining factorial invariance: A multiple testing procedure. Educational and Psychological Measurement, 73, 713–727.
22.
RevueltaJ.Franco-MartinezA.XimenezC. (2021). Nominal factor analysis of situational judgment tests: Evaluation of latent dimensionality and factorial invariance. Educational and Psychological Measurement, 81, 1–35.
23.
RobitzschA.LüdtkeO. (2023). Why full, partial, or approximate measurement invariance are not a prerequisite for meaningful and valid group comparisons. Structural Equation Modeling, 30, 859–870.
24.
Stata Base Reference Manual. (2023). College Station, TX: Stata Press.
25.
WassermanL. W. (2004). All of statistics. Springer.
26.
ZhengX.Rabe-HeskethS. (2007). Estimating parameters of dichotomous and ordinal item response models with gllamm. Stata Journal, 7, 313–333.
