Management researchers now have the option of using the path model fit index RMSEA-P as they evaluate their latent variable models to overcome limitations of global fit indices (CFI, RMSEA, SRMR). Two simulation studies of the effectiveness of the RMSEA-P reached different conclusions about its merit, one favorable and the other very unfavorable (
Lance et al., 2016). The present research is a constructive reproduction of Lance et al. with analytical improvements. We failed to reproduce their key negative findings that correctly specified models were retained in less than 50% of cases, and incorrectly specified models were retained in over 50% of cases. Instead, using our improved analysis techniques, we found that correct models were identified in 92% of cases and incorrect models were retained in less than 10% of cases. Our results also show the RMSEA-P works best when used with a Traditional Model Selection Strategy.
AndersonJ. C.GerbingD. W. (1988). Structural equation modeling in practice: A review and recommended two-step approach. Psychological Bulletin, 103(3), 411–423. https://doi.org/10.1037/0033-2909.103.3.411
2.
BentlerP. M.BonettD. G. (1980). Significance tests and goodness of t in the analysis of covariance struc-tures. Psychological Bulletin, 88(3), 588. https://doi.org/10.1037/0033-2909.88.3.588
3.
CortinaJ. M.KöhlerT.AulisiL. C. (2023). Current reproducibility practices in management: What they are versus what they could be. Journal of Management Scientific Reports, 1(3-4), 171–205. https://doi.org/10.1177/27550311231202696
DuncanO.HallerA.PortesA. (1971). Peer influence on aspiration: A reinterpretation. In BlalockH. M. (Ed.), Causal Models in the Social Sciences (pp. 219–244). Aldine-Atherton.
7.
EcobR. (1987). Application of structural equation modeling to longitudinal educational data. In CuttanceeP.EcobR. (Eds.), Structural Modeling by Example (pp. 138–159). Cambridge University Press.
8.
JamesL. R.MulaikS. A.BrettJ. M. (1982). Causal analysis: Assumptions, models, and data. Sage, 1.
9.
KennyD. A.KaniskanB.McCoachD. B. (2015). The performance of RMSEA in models with small degrees of freedom. Sociological Methods & Research, 44(3), 486–507. https://doi.org/10.1177/0049124114543236
10.
KöhlerT.CortinaJ. M. (2023). Constructive replication, reproducibility, and generalizability: Getting theory testing for JOMSR right. Journal of Management Scientific Reports, 1(2), 75–93. https://doi.org/10.1177/27550311231176016
11.
LanceC. E.BeckS. S.FanY.CarterN. T. (2016). A taxonomy of path-related goodness-of-fit indices and recommended criterion values. Psychological Methods, 21(3), 388–404. https://doi.org/10.1037/met0000068
McDonaldR. P.HoM. H. R. (2002). Principles and practice in reporting structural equation analyses. Psychological Methods, 7(1), 64–82. https://doi.org/10.1037/1082-989x.7.1.64
14.
MulaikS. A.JamesL. R.Van AlstineJ.BennettN.LindS.StilwellC. D. (1989). Evaluation of goodness-of-fit indices for structural equation models. Psychological Bulletin, 105(3), 430–445. https://doi.org/10.1037/0033-2909.105.3.430
15.
O’BoyleE. H.WilliamsL. J. (2011). Decomposing model t: Measurement versus theory in organizational research using latent variables. Journal of Applied Psychology, 96(1), 1–12. https://doi.org/10.1037/a0020539
16.
SavaleiV.BraceJ. C.FouladiR. T. (2024). We need to change how we compute RMSEA for nested model comparisons in structural equation modeling. Psychological Methods, 29(3), 480–493. https://doi.org/10.1037/met0000537
17.
WilliamsL. J. (2025). A commentary on bazzoli (2024): Approximate fit indices thresholds and theory testing. Group & Organization Management, 50(4), 1156–1163. https://doi.org/10.1177/10596011251319819
18.
WilliamsL. J.HolahanP. J. (1994). Parsimony-based fit indices for multiple-indicator models: Do they work?Structural Equation Modeling: A Multidisciplinary Journal, 1(2), 161–189. https://doi.org/10.1080/10705519409539970
19.
WilliamsL. J.O’BoyleE. (2011). The myth of global fit indices and alternatives for assessing latent Variable relations. Organizational Research Methods, 14(2), 350–369. https://doi.org/10.1177/1094428110391472
20.
WilliamsL. J.O’BoyleE. H.YuJ. (2020). Condition 9 and 10 tests of model confirmation: A review of james, mulaik, and brett (1982) and contemporary alternatives. Organizational Research Methods, 23(1), 6–29. https://doi.org/10.1177/1094428117736137
21.
WilliamsL. J.WilliamsA. R.O’BoyleE. H. (2024). Assessment of path model fit: Evidence of effectiveness and recommendations for use of the RMSEA-P. Organizational Research Methods, 27(1), 64–87. https://doi.org/10.1177/10944281221124946
